-- Logs begin at Wed 2022-08-24 14:00:26 UTC, end at Wed 2022-08-24 15:00:18 UTC. -- Aug 24 14:32:13.663547 dv-cinder-848899-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:32:13.672879 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:32:13 2022] *** Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: nodename: dv-cinder-848899-4-iscsi Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: machine: x86_64 Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: clock source: unix Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: pcre jit disabled Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: detected number of CPU cores: 4 Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: current working directory: / Aug 24 14:32:13.674822 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: your processes number limit is 47680 Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: your memory page size is 4096 bytes Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: detected max file descriptor number: 2048 Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: lock engine: pthread robust mutexes Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: thunder lock: enabled Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:32:13.675424 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:32:13.713558 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: Python main interpreter initialized at 0x55f1ffc8e9c0 Aug 24 14:32:13.713558 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: python threads support enabled Aug 24 14:32:13.713558 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: your server socket listen backlog is limited to 100 connections Aug 24 14:32:13.713558 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:32:13.713942 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:32:13.713942 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: *** Operational MODE: preforking *** Aug 24 14:32:13.714237 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:32:13.714237 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: spawned uWSGI master process (pid: 112255) Aug 24 14:32:13.714454 dv-cinder-848899-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:32:13.715459 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: spawned uWSGI worker 1 (pid: 112267, cores: 1) Aug 24 14:32:13.715459 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: spawned uWSGI worker 2 (pid: 112268, cores: 1) Aug 24 14:32:13.715459 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:32:14.378918 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:32:14.408231 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:32:15.442294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:32:15.442294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: from cryptography.utils import int_from_bytes Aug 24 14:32:15.442956 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:32:15.442956 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: from cryptography.utils import int_from_bytes Aug 24 14:32:15.447592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:32:15.447592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: from cryptography.utils import int_from_bytes Aug 24 14:32:15.448070 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:32:15.448070 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: from cryptography.utils import int_from_bytes Aug 24 14:32:17.919167 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:32:17.919866 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:32:17.919957 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:32:17.919957 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:32:17.920373 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:32:17.920373 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:32:17.920503 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:32:17.920575 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:32:17.920659 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:32:17.920844 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.920932 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:32:17.921176 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.921321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.921502 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.921663 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.921761 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.921847 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922113 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922247 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922422 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922588 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922818 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.922953 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923149 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923381 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923524 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923627 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923722 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.923930 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924077 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924218 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-4-iscsi {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924365 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924530 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924634 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-4-iscsi {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924831 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.924936 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925132 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925219 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925440 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925526 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925738 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.925833 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926043 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926136 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926353 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926443 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926676 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.926864 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927177 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927293 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927490 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927626 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927790 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.927911 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928105 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928230 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928451 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928611 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928744 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.928845 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929050 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929143 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929369 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929459 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929675 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929770 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.929978 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.930072 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.930287 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.930375 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-4-iscsi {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.930693 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.930783 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-4-iscsi {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931005 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931123 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931313 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931411 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931641 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.931783 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932003 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932099 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932306 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932394 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932617 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932702 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.932931 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933018 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933234 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933540 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933642 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933854 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.933951 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934192 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934286 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934506 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934607 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934820 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.934920 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935123 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935210 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935424 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935528 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935737 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.935833 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936036 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936130 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936339 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936424 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936586 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936684 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936887 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.936973 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937197 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937283 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937509 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937824 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.937925 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938085 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938180 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938307 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938409 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938670 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938785 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.938986 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939084 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939291 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939385 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939593 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939688 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939895 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.939984 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940197 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940298 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940496 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940583 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940795 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.940883 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941104 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941249 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941392 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941477 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941696 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.941789 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942005 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942089 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942319 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942412 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942639 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942729 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.942953 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943042 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943269 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943354 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943575 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943663 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943876 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.943962 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944189 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944282 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944506 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944591 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944809 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.944895 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945119 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945215 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945433 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945533 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945731 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.945817 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946032 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946129 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946337 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946429 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946665 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946754 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.946984 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947090 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947298 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947384 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947530 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947618 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947824 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.947911 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948121 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948207 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948421 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948520 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948724 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.948842 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949025 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949121 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949323 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949433 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949616 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949721 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.949967 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950059 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950263 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950350 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950580 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950672 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950882 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.950976 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951181 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951310 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951481 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951573 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951777 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.951863 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952078 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952173 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952374 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952461 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952675 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952761 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.952984 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953081 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953284 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953380 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953581 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953675 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953878 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.953977 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954174 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954263 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954479 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954607 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954799 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.954897 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955099 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955186 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955400 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955487 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955699 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955802 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.955996 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956089 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956298 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956383 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956596 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956695 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956892 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.956977 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957191 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957282 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957483 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957582 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957781 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.957906 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958083 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958168 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958397 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958493 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958733 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.958874 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959037 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959136 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959334 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959420 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959633 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959720 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.959930 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960015 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960223 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960368 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960518 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960604 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960810 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.960895 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961104 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961197 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961418 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961570 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961717 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.961803 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962016 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962109 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962315 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962403 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962646 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962750 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.962960 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:32:17.963047 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.963282 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.963366 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.963607 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.963708 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.963915 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964238 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964324 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964564 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964658 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964877 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.964965 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965182 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965268 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965513 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965600 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965832 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.965929 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966139 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966232 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966447 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966550 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966784 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.966871 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967096 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967243 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967405 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967492 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967716 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.967812 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968028 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968115 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968340 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968435 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968652 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968739 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.968958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969045 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969268 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969355 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969584 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969694 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969898 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.969985 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970203 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970297 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970549 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970639 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970873 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.970977 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971181 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971267 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971500 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971588 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971816 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.971910 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972126 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972219 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972434 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972532 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972739 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.972837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973049 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973142 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973372 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973460 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973678 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973778 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.973990 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974077 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974295 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974388 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974626 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974731 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.974937 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975025 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975244 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975329 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975549 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975646 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975860 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.975954 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976179 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976270 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976491 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976587 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976799 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.976885 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977109 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977196 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977415 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977501 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977720 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.977805 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978024 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978156 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978323 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978411 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978649 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978740 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.978951 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979085 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979255 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979354 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979550 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979635 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979853 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.979952 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980258 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980467 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980560 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980785 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.980880 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981133 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981231 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981441 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981534 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981746 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.981849 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982050 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982140 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982347 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982474 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982674 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982764 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.982981 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983066 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983279 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983364 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983582 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983680 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983889 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.983975 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984188 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984273 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984497 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984591 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984794 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.984880 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985094 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985179 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985393 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985480 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985697 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.985781 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986000 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986100 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986308 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986393 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986639 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986744 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.986952 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987046 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987259 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987344 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987564 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987650 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987871 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.987965 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988203 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988301 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988500 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988585 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988817 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.988912 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989135 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989220 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989442 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989526 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989739 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.989827 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990043 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990137 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990341 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990429 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990701 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990807 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.990960 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991059 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991260 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991345 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991554 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991648 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991850 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.991948 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992147 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992234 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992442 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992572 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992738 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.992824 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993037 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993131 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993340 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993425 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993637 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993731 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.993935 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994030 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994230 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994319 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994552 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994665 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994880 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.994985 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995186 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995294 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995519 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995612 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995830 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.995994 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996153 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996252 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996475 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996562 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996809 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.996897 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997112 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997196 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997435 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997522 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997724 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.997821 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998028 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998115 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998337 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998423 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998679 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998770 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.998988 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999076 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999305 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999402 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999613 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999707 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999913 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:17.999999 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000225 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000310 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000521 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000607 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000832 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.000926 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001145 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001244 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001476 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001561 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001786 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.001878 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002099 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002193 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002402 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002489 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002732 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.002822 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003034 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003128 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003337 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003423 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003639 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003740 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.003941 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004107 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004251 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004350 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004552 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004638 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004859 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.004946 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005161 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005247 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005468 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005553 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005766 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.005860 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006075 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006169 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006374 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006468 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006705 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.006802 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007019 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007340 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007425 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007647 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007735 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.007953 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008039 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008260 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008355 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008563 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008648 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008867 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.008953 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009171 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009264 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009466 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009555 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009765 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.009859 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010067 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010162 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010371 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010464 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010700 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.010788 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011004 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011103 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011301 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011387 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011601 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011686 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011902 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.011995 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012233 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012319 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012566 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012660 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012875 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.012963 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013186 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013280 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013491 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013576 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013805 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.013892 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014115 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014206 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014413 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014499 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014746 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.014842 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015047 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015136 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015357 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015442 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015656 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015751 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.015956 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016041 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016257 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016389 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016558 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016645 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016882 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.016968 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.017181 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.017276 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.017482 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.017575 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018137 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018224 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018441 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018620 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018771 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.018859 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019076 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019162 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019377 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019515 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019683 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019776 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.019988 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020073 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020290 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020377 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020594 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020682 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020894 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.020979 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021194 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021282 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021497 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021586 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021801 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.021888 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022103 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022196 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022404 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022490 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022731 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.022854 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023028 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023117 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023328 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023415 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023635 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023731 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.023950 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.024201 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.024525 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.024621 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.024833 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.024932 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025147 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025240 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025459 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025546 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025772 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.025868 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026088 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026173 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026410 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026571 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026763 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.026862 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027062 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027158 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027366 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027462 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027663 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027750 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.027999 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028169 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028304 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028391 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028604 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028690 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.028906 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029007 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029207 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029509 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029646 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029806 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.029900 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030187 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030289 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030419 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030530 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030719 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.030808 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031026 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031116 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031323 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031409 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031626 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031714 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.031922 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032011 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032222 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032308 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032526 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032614 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032826 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.032921 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033123 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033210 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033420 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033508 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033720 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.033805 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034040 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034135 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034357 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034455 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034716 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.034819 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035044 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035142 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035354 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035441 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035677 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035762 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.035982 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036082 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036305 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036393 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036601 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036688 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036899 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.036994 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037199 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037285 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037499 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037584 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037797 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.037886 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038097 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038195 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038398 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038484 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038728 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.038817 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039032 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039121 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039329 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039416 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039629 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039716 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.039925 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040010 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040224 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040309 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040523 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040610 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040819 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.040912 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041116 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041215 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041413 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041499 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041712 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.041797 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042008 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042107 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042308 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042401 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042630 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042719 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.042929 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043027 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043226 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043582 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043681 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043881 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.043980 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044186 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044280 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044485 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044582 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044780 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.044869 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045077 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045169 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045383 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045470 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045680 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045776 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.045975 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046062 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046275 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046361 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046590 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046724 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.046890 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047013 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047190 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047288 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047498 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047587 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047806 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.047891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048104 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048198 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048406 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048501 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048703 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048789 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.048999 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049101 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049293 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049388 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049593 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049886 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.049985 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050181 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050268 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050475 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050591 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050795 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.050896 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051089 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051179 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051387 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051473 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051691 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051786 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.051987 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052076 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052285 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052415 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052579 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052669 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052882 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.052968 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053194 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053280 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053513 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053600 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053828 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.053913 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054137 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054223 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054450 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054555 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054779 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.054866 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055081 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055182 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055388 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055482 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055683 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055824 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.055988 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056153 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056294 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056381 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056601 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056688 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056896 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.056992 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057196 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057283 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057496 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057581 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057801 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.057901 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058106 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058201 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058410 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058498 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058745 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.058842 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059082 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059170 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059401 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059493 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059705 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.059793 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060008 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060095 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060313 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060409 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060616 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060705 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.060920 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061010 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061224 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061309 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061526 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061612 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061829 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.061915 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062132 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062218 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062438 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062550 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062775 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.062873 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063080 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063175 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063384 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063469 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063683 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063776 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.063983 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064078 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064293 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064378 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064681 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064892 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.064987 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065202 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065297 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065503 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065598 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065811 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.065900 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066112 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066288 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066561 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066653 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066863 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.066988 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067294 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067473 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067602 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067781 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.067909 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068089 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068220 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068402 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068529 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068714 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.068827 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069015 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069238 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069432 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069546 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069746 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.069855 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070056 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070165 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070365 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070461 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070692 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070781 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.070992 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071079 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071301 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071396 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071623 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071722 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.071926 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072015 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072221 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072315 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072520 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072650 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072821 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.072907 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073123 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073211 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073438 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073562 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.073922 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074130 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074226 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074447 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074552 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074874 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.074962 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075182 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075270 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075499 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075585 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075814 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.075901 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076131 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076219 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076429 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076516 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076735 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.076831 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077039 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077127 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077345 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077433 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077659 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.077968 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078054 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078278 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078366 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078604 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.078910 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079009 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079227 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079313 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079539 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079635 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079850 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.079946 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080169 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080257 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080557 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080651 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080865 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.080961 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081181 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081274 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081498 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081584 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081799 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.081888 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082098 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082185 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082401 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082494 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082723 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.082814 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083023 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083112 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083331 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083427 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083629 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083716 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.083935 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084022 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084241 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084328 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084546 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084635 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084846 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.084933 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085145 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085240 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085447 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085536 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085741 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.085827 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086053 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086147 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086360 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086447 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086697 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.086786 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087012 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087151 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087311 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087399 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087619 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087707 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.087920 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088014 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088219 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088306 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088516 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088603 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088811 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.088912 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089110 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089205 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089433 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089519 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089739 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.089833 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090057 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090145 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090429 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090538 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090759 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.090887 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091077 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091172 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091395 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091489 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091709 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.091798 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092020 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092107 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092333 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092428 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092631 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092724 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.092929 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093027 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093229 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093325 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093526 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093612 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093827 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.093915 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094124 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094220 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094426 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094570 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094759 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.094847 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095061 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095194 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095365 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095452 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095666 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095753 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.095971 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096060 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096272 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096358 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096580 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096673 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096879 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.096976 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097178 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097265 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097474 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097561 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097772 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.097868 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098095 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098190 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098401 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098488 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098730 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.098835 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099046 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099135 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099357 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099453 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099668 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099755 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.099976 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100064 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100285 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100382 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100596 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100683 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100903 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.100989 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101213 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101309 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101517 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101604 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101824 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.101918 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102129 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102439 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102545 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102794 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.102971 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103295 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103396 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103604 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103693 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103911 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.103998 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104220 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104317 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104528 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104622 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104840 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.104936 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105146 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105233 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105455 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105541 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105763 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.105850 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106097 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106193 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106408 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106505 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106786 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.106897 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107072 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107160 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107393 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107488 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107718 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.107818 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108028 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108124 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108337 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108432 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108644 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.108953 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109046 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109307 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109396 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109624 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109714 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.109929 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110016 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110237 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110335 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110569 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110659 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110879 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.110965 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111184 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111283 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111490 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111576 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111803 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.111897 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112115 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112211 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112420 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112527 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112731 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.112833 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113039 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113135 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113350 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113436 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113674 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113769 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.113991 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114078 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114301 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114388 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114638 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114729 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.114951 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.115039 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.115266 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.115459 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.115769 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.115868 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116087 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116180 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116403 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116489 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116718 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.116814 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117030 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117117 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117343 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117429 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117656 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117750 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.117955 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118041 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118256 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118343 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118585 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118692 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118893 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.118980 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119192 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119280 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119495 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119582 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119802 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.119890 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120102 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120189 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120409 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120497 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120712 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.120798 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.121023 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.121239 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.121601 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.121693 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.121947 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122034 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122263 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122350 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122609 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122700 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.122925 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123021 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123230 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123326 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123532 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123626 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123836 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.123923 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124138 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124234 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124442 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124528 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124748 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.124843 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125051 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125147 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125351 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125440 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125653 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125738 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.125957 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126057 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126261 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126350 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126584 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126684 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126884 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.126972 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127186 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127272 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127494 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127580 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127798 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.127886 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128098 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128184 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128400 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128487 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128697 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128784 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.128996 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129090 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129380 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129593 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129676 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129893 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.129979 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130189 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130284 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130487 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130622 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130808 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.130910 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131108 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131204 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131406 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131493 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131706 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.131801 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132001 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132095 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132306 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132400 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132605 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132699 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.132913 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133007 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133244 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133338 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133553 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133640 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133858 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.133955 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134166 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134252 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134473 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134577 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134805 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.134894 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.135133 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.135219 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.135448 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.135659 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.135978 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136075 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136302 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136395 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136619 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136705 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.136944 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137032 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137290 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137380 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137596 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137691 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.137914 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138024 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138198 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138290 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138529 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138699 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138846 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.138936 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139155 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139242 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139463 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139557 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139770 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.139856 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140080 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140167 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140482 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140692 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140786 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.140998 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141095 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141303 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141391 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141608 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141696 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.141913 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.142001 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.142219 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.142307 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.142533 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.142926 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143165 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143263 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143481 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143568 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143797 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.143883 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144108 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144204 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144421 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144508 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144733 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.144819 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145037 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145181 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145342 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145437 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145645 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145733 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.145948 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146044 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146256 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146344 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146590 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146680 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146898 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.146993 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.147199 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.147289 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.147501 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.147591 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.147908 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148007 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148217 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148303 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148530 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148615 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148836 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.148979 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149142 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149263 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149455 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149554 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149759 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.149882 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150063 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150150 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150367 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150462 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150705 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.150800 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151035 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151124 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151355 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151450 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151672 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151766 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.151970 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152064 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152267 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152356 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152565 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152652 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.152919 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153009 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153233 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153380 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153534 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153700 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.153832 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154128 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154225 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154431 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154540 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154752 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.154842 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155053 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155142 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155354 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155440 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155650 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.155953 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156041 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156256 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156350 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156552 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156651 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156850 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.156939 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157145 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157232 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157441 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157529 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157737 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.157879 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158037 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158123 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158335 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158430 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158655 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.158953 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159042 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159255 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159349 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159550 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159643 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159853 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.159976 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160152 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160250 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160481 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160569 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160795 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.160882 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161098 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161195 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161412 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161499 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161718 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.161805 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162033 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162122 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162343 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162429 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162674 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162774 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.162981 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163069 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163299 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163385 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163604 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163692 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.163911 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164008 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164215 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164311 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164521 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164608 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164829 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.164919 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165134 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165221 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165443 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165538 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165755 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.165842 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166058 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166154 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166376 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166472 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166705 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.166802 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167019 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167105 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167331 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167497 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167635 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167722 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.167951 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168044 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168253 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168341 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168681 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168899 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.168986 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169248 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169352 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169504 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169592 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169810 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.169906 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170110 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170197 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170417 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170530 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170749 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.170848 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171058 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171145 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171373 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171467 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171689 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171785 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.171992 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172078 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172310 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172397 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172616 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172712 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.172937 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173025 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173254 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173339 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173689 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173903 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.173988 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174208 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174294 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174550 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174643 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174833 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.174922 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.175071 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:32:18.175181 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.175485 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:32:18.175728 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:32:18.329799 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO dbcounter [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Registered counter for database nova_api Aug 24 14:32:18.330024 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO dbcounter [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Registered counter for database nova_api Aug 24 14:32:18.351481 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_db.sqlalchemy.engines [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.353827 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_db.sqlalchemy.engines [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.361800 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writer thread running {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.363678 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writer thread running {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.421783 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.context [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),018ea49c-ac3d-448e-85b1-659198c7a196(cell1) {{(pid=112268) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:32:18.422285 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.context [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),018ea49c-ac3d-448e-85b1-659198c7a196(cell1) {{(pid=112267) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:32:18.425592 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:18.426064 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:18.426217 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:18.426620 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:18.427697 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:18.428237 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:18.428395 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:18.428858 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:18.428991 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:18.429402 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:18.430879 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:18.431448 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_concurrency.lockutils [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:18.432879 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO dbcounter [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Registered counter for database nova_cell0 Aug 24 14:32:18.433437 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO dbcounter [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Registered counter for database nova_cell0 Aug 24 14:32:18.438604 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO dbcounter [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Registered counter for database nova_cell1 Aug 24 14:32:18.439067 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO dbcounter [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Registered counter for database nova_cell1 Aug 24 14:32:18.446285 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_db.sqlalchemy.engines [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.450030 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_db.sqlalchemy.engines [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.451543 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_db.sqlalchemy.engines [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.451899 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writer thread running {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.452665 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_db.sqlalchemy.engines [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.458471 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writer thread running {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.460012 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writer thread running {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.590613 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writer thread running {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.599588 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO dbcounter [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Registered counter for database nova_cell0 Aug 24 14:32:18.603051 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO dbcounter [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Registered counter for database nova_cell0 Aug 24 14:32:18.611277 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_db.sqlalchemy.engines [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.614161 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG oslo_db.sqlalchemy.engines [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:32:18.619242 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writer thread running {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.619506 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writer thread running {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:32:18.953261 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: WARNING keystonemiddleware.auth_token [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:32:18.958595 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: WARNING keystonemiddleware.auth_token [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:32:18.960704 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: WARNING keystonemiddleware.auth_token [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:32:18.966130 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: WARNING keystonemiddleware.auth_token [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:32:19.300065 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: WARNING keystonemiddleware.auth_token [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:32:19.306083 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: WARNING keystonemiddleware.auth_token [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:32:19.310405 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: WARNING keystonemiddleware.auth_token [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:32:19.311355 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1ffc8e9c0 pid: 112268 (default app) Aug 24 14:32:19.313422 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:19.314617 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 24 14:32:19.315024 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Wed Aug 24 14:32:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:32:19.316437 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: WARNING keystonemiddleware.auth_token [None req-efe09409-a825-47a3-95d9-788d3a8367a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:32:19.321639 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1ffc8e9c0 pid: 112267 (default app) Aug 24 14:33:37.698706 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:37.699729 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 24 14:33:37.700129 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:37.716478 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_api:SELECT=3 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:37.717313 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_cell0:SELECT=3 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:37.718064 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_cell1:SELECT=3 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:37.718850 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:38.613600 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-ebd5012c-8ad8-4e13-9927-c7e5f5183331 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:38.646171 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-ebd5012c-8ad8-4e13-9927-c7e5f5183331 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939101 Aug 24 14:33:38.650593 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Aug 24 14:33:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:40.979801 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:40.980809 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-1e5fdd00-199e-4270-987a-6fa9e7798a44 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 14:33:40.981177 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:41.442014 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-810011fb-d6fb-4f31-98e1-62425b1314d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "name": "cirros256"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:41.462192 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:33:41.462192 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: warnings.warn(msg) Aug 24 14:33:41.492865 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-810011fb-d6fb-4f31-98e1-62425b1314d6 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505276 Aug 24 14:33:41.494768 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:33:41.507806 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_api:SELECT=3 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:41.508741 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_cell1:SELECT=3 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:41.510033 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_cell0:SELECT=3 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:41.510858 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:41.720955 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-5e1b6370-664d-47dc-9516-0a011cdd56e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:41.725389 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:33:41.725389 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:33:41.787402 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-5e1b6370-664d-47dc-9516-0a011cdd56e6 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285098 Aug 24 14:33:41.792502 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Aug 24 14:33:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:44.124035 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-810011fb-d6fb-4f31-98e1-62425b1314d6 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:44.125774 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-810011fb-d6fb-4f31-98e1-62425b1314d6 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003041 Aug 24 14:33:44.126200 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:44.783584 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-c75fb21b-5295-4bb1-8b89-de41bec0ec23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:44.803434 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:33:44.803434 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:33:44.836296 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-c75fb21b-5295-4bb1-8b89-de41bec0ec23 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703169 Aug 24 14:33:44.837150 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:33:44.850379 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-af5560ee-8bf0-4f6b-b349-7416d2d85c30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:44.854152 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:33:44.854152 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: warnings.warn(msg) Aug 24 14:33:44.891895 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-af5560ee-8bf0-4f6b-b349-7416d2d85c30 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045202 Aug 24 14:33:44.902568 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Aug 24 14:33:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:47.260416 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-c75fb21b-5295-4bb1-8b89-de41bec0ec23 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:47.261365 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-c75fb21b-5295-4bb1-8b89-de41bec0ec23 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 14:33:47.261821 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:47.663030 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-de1cb49f-814b-48e1-bb5c-7245a5026156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:47.682663 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-de1cb49f-814b-48e1-bb5c-7245a5026156 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.414248 Aug 24 14:33:47.683240 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:33:47.695646 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-c77bb098-c78c-4749-833e-216ef44a4984 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:47.721266 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-c77bb098-c78c-4749-833e-216ef44a4984 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029422 Aug 24 14:33:47.737957 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Aug 24 14:33:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:50.091296 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-de1cb49f-814b-48e1-bb5c-7245a5026156 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:50.092326 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-de1cb49f-814b-48e1-bb5c-7245a5026156 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 24 14:33:50.092733 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:50.598712 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-d9d63e9d-3841-431a-bd18-97d21e31a06b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "swap": 0, "ram": 2048, "disk": 10}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:50.621290 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-d9d63e9d-3841-431a-bd18-97d21e31a06b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522216 Aug 24 14:33:50.627052 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:33:50.634753 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-e0ef0a3b-d0a8-4308-90b8-19c3254aeccc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:50.664699 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-e0ef0a3b-d0a8-4308-90b8-19c3254aeccc admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034102 Aug 24 14:33:50.676490 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Aug 24 14:33:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:52.992707 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-d9d63e9d-3841-431a-bd18-97d21e31a06b admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:52.993827 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-d9d63e9d-3841-431a-bd18-97d21e31a06b admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 14:33:52.994286 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:53.454332 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "name": "ds4G", "swap": 0}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:53.474579 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473863 Aug 24 14:33:53.479136 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:33:53.487171 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-5f64fce6-37e3-40e0-892b-7a7b5cf65d16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:53.512795 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-5f64fce6-37e3-40e0-892b-7a7b5cf65d16 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029302 Aug 24 14:33:53.513383 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Aug 24 14:33:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:33:56.156704 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:56.157727 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 24 14:33:56.158190 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:56.601264 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-0dcb6028-7eb6-4c68-8727-7f77bd4bb93c admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:56.626777 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-0dcb6028-7eb6-4c68-8727-7f77bd4bb93c admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461860 Aug 24 14:33:56.627517 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Aug 24 14:33:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:33:59.335159 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:33:59.336983 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-32ce3ce2-430c-49cc-ae5a-bb70a665af8e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Aug 24 14:33:59.337792 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:33:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:33:59.872954 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-005d91cc-47bf-4dd9-8419-d8dd283ef33e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:59.894268 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-005d91cc-47bf-4dd9-8419-d8dd283ef33e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.545372 Aug 24 14:33:59.895034 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:33:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:33:59.907170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-0ef42615-6bd7-4fe9-8694-1f0b81e30279 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:33:59.933959 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-0ef42615-6bd7-4fe9-8694-1f0b81e30279 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030374 Aug 24 14:33:59.934911 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Aug 24 14:33:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:34:02.239629 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-005d91cc-47bf-4dd9-8419-d8dd283ef33e admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:02.240639 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-005d91cc-47bf-4dd9-8419-d8dd283ef33e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 14:34:02.241006 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:02.688827 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-79e308a5-1431-440b-ad5e-80b6f9da3cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:02.710427 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-79e308a5-1431-440b-ad5e-80b6f9da3cb6 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461885 Aug 24 14:34:02.710955 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:34:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:34:02.723197 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-4f5df29a-f472-4d70-a23e-a49e4e4a4418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:02.749255 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-4f5df29a-f472-4d70-a23e-a49e4e4a4418 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029635 Aug 24 14:34:02.749820 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Aug 24 14:34:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:34:05.097144 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-79e308a5-1431-440b-ad5e-80b6f9da3cb6 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:05.098898 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-79e308a5-1431-440b-ad5e-80b6f9da3cb6 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Aug 24 14:34:05.099754 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:05.522902 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-4265c2e4-015c-46fd-a139-d49bfda0b633 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:05.546688 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-4265c2e4-015c-46fd-a139-d49bfda0b633 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.440630 Aug 24 14:34:05.547668 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:34:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:34:05.559753 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-ef3b5aae-1e39-48e1-a6ab-34ac60f963a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:05.586347 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-ef3b5aae-1e39-48e1-a6ab-34ac60f963a8 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030385 Aug 24 14:34:05.587316 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Aug 24 14:34:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:34:07.952269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-4265c2e4-015c-46fd-a139-d49bfda0b633 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:07.953325 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-4265c2e4-015c-46fd-a139-d49bfda0b633 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 24 14:34:07.953910 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:34:08.387848 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-cdbb2e24-e069-4b1b-8a63-355424b33933 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:08.393886 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:08.411789 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-cdbb2e24-e069-4b1b-8a63-355424b33933 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451576 Aug 24 14:34:08.412375 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:34:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:34:08.424753 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-1a2d900f-966e-42d1-9660-765e54ac56c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:08.453284 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-1a2d900f-966e-42d1-9660-765e54ac56c1 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032480 Aug 24 14:34:08.454179 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Aug 24 14:34:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:34:10.803044 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-cdbb2e24-e069-4b1b-8a63-355424b33933 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:10.804360 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-cdbb2e24-e069-4b1b-8a63-355424b33933 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 24 14:34:10.810587 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:11.329402 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "vcpus": 8, "swap": 0}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:11.349854 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.535987 Aug 24 14:34:11.350659 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Aug 24 14:34:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:34:11.363757 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-ea5f8654-ad80-4d92-a125-307d5e14d96e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:11.390825 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-ea5f8654-ad80-4d92-a125-307d5e14d96e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030910 Aug 24 14:34:11.394540 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Aug 24 14:34:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:34:29.830403 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:29.831562 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Aug 24 14:34:29.832125 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:29.846067 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:30.259863 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-04c0c317-138b-4df5-9bfb-707fd2fc3259 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:30.279562 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-04c0c317-138b-4df5-9bfb-707fd2fc3259 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440875 Aug 24 14:34:30.280078 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Aug 24 14:34:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:31.367272 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:31.368340 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-40d9b54a-b5f0-417f-8dc2-eb905fed02e9 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 24 14:34:31.368805 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:31.940715 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-56fdb3da-4823-40ae-930e-8ce5784800d2 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:31.946427 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.wsgi [None req-56fdb3da-4823-40ae-930e-8ce5784800d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-56fdb3da-4823-40ae-930e-8ce5784800d2 admin admin] Request method failure captured: Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept: application/json Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept-Encoding: gzip, deflate Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Connection: keep-alive Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Content-Length: 0 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Host: 10.222.0.90 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-System-Scope: None Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: User-Agent: python-novaclient Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Auth-Token: gAAAAABjBjb3B25tH6XQQnPzG6M2Ichb4XJhfJRiPISgi-DprbnY1awVZK8q9Z9ALTm-A-aiZPjc22i_BGU8xSZFsBfbyRYVYoJz4wGdRYOIwo_fhzu_CMhbbDrzPyD2jMovf-oa6refejnjNUmsnPeHNzV38nJYVUy6dt--4Eh-A2-XGHLcHSM Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Id: None Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Name: None Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Identity-Status: Confirmed Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Is-Admin-Project: True Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Id: default Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Name: Default Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Name: admin Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Role: member,reader,admin Aug 24 14:34:31.949737 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Roles: member,reader,admin Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant: admin Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Name: admin Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User: admin Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Id: default Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Name: Default Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Name: admin Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: method: > Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: exception: Flavor 42 could not be found. Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: action_args: {'id': '42'} Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:31.951662 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:31.955694 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:31.957170 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-56fdb3da-4823-40ae-930e-8ce5784800d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:31.958306 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-56fdb3da-4823-40ae-930e-8ce5784800d2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.443402 Aug 24 14:34:31.958306 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Aug 24 14:34:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:31.963707 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-5523600a-1838-4b83-90e6-dbf98f867457 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:31.969434 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:31.992993 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-5523600a-1838-4b83-90e6-dbf98f867457 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034668 Aug 24 14:34:31.993545 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:32.006048 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-67e9c39f-9689-41fa-88ba-86155231d932 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:32.033727 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-67e9c39f-9689-41fa-88ba-86155231d932 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033307 Aug 24 14:34:32.034295 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:32.046998 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-22093b0f-d567-46fc-99c3-46afdd9260de admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:32.055416 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.wsgi [None req-22093b0f-d567-46fc-99c3-46afdd9260de admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-22093b0f-d567-46fc-99c3-46afdd9260de admin admin] Request method failure captured: Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept: application/json Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept-Encoding: gzip, deflate Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Connection: keep-alive Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Content-Length: 0 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Host: 10.222.0.90 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-System-Scope: None Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: User-Agent: python-novaclient Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Auth-Token: gAAAAABjBjb3B25tH6XQQnPzG6M2Ichb4XJhfJRiPISgi-DprbnY1awVZK8q9Z9ALTm-A-aiZPjc22i_BGU8xSZFsBfbyRYVYoJz4wGdRYOIwo_fhzu_CMhbbDrzPyD2jMovf-oa6refejnjNUmsnPeHNzV38nJYVUy6dt--4Eh-A2-XGHLcHSM Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Id: None Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Name: None Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Identity-Status: Confirmed Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Is-Admin-Project: True Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Id: default Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Name: Default Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Name: admin Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Role: member,reader,admin Aug 24 14:34:32.058661 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Roles: member,reader,admin Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant: admin Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Name: admin Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User: admin Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Id: default Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Name: Default Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Name: admin Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: method: > Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: exception: Flavor 42 could not be found. Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: action_args: {'id': '42'} Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:32.060107 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:32.061097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:32.062386 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-22093b0f-d567-46fc-99c3-46afdd9260de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:32.063637 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-22093b0f-d567-46fc-99c3-46afdd9260de admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.019499 Aug 24 14:34:32.063637 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Aug 24 14:34:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:33.048551 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-67e9c39f-9689-41fa-88ba-86155231d932 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:33.049555 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-67e9c39f-9689-41fa-88ba-86155231d932 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 14:34:33.049923 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:34:33.620591 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-d8bc0e18-d03f-419b-8f3b-29e7b4791d4b admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:33.629110 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.wsgi [None req-d8bc0e18-d03f-419b-8f3b-29e7b4791d4b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-d8bc0e18-d03f-419b-8f3b-29e7b4791d4b admin admin] Request method failure captured: Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept: application/json Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept-Encoding: gzip, deflate Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Connection: keep-alive Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Content-Length: 0 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Host: 10.222.0.90 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-System-Scope: None Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: User-Agent: python-novaclient Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Auth-Token: gAAAAABjBjb4ICs8WwIEWnQ5HQ_vX68SGg5rdw_atH-CIL1baZ5RFOw5ALLbUlfoeLySJsVzHgNCbdjpthNGoNjn3F41GDDNgf7KU5QjK-B7hEXZUyGOOP06mg_9xpMqCErjXmFJL8UM0jjiQaEoZgtk9jT9wfOn1vMF5zBOrse-I0JM02xHo_I Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Id: None Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Name: None Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Identity-Status: Confirmed Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Is-Admin-Project: True Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Id: default Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Name: Default Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Name: admin Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Role: member,reader,admin Aug 24 14:34:33.630679 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Roles: member,reader,admin Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant: admin Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Name: admin Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User: admin Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Id: default Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Name: Default Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Name: admin Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: method: > Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: exception: Flavor 84 could not be found. Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: action_args: {'id': '84'} Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:33.632269 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:33.633159 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.635055 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-d8bc0e18-d03f-419b-8f3b-29e7b4791d4b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:33.636077 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-d8bc0e18-d03f-419b-8f3b-29e7b4791d4b admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.450649 Aug 24 14:34:33.636077 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Aug 24 14:34:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:33.643625 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-e0455177-bb63-461a-bd47-6a888d4cfc4e admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:33.659363 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-e0455177-bb63-461a-bd47-6a888d4cfc4e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019616 Aug 24 14:34:33.659888 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:33.669713 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-4f64b379-910a-456e-be4f-3c20d55a94f5 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:33.685548 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-4f64b379-910a-456e-be4f-3c20d55a94f5 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019542 Aug 24 14:34:33.686065 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:33.697558 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-81461646-2e41-4b20-aee6-593a272c2f4f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:33.704016 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.wsgi [None req-81461646-2e41-4b20-aee6-593a272c2f4f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-81461646-2e41-4b20-aee6-593a272c2f4f admin admin] Request method failure captured: Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept: application/json Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept-Encoding: gzip, deflate Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Connection: keep-alive Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Content-Length: 0 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Host: 10.222.0.90 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-System-Scope: None Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: User-Agent: python-novaclient Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Auth-Token: gAAAAABjBjb4ICs8WwIEWnQ5HQ_vX68SGg5rdw_atH-CIL1baZ5RFOw5ALLbUlfoeLySJsVzHgNCbdjpthNGoNjn3F41GDDNgf7KU5QjK-B7hEXZUyGOOP06mg_9xpMqCErjXmFJL8UM0jjiQaEoZgtk9jT9wfOn1vMF5zBOrse-I0JM02xHo_I Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Id: None Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Name: None Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Identity-Status: Confirmed Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Is-Admin-Project: True Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Id: default Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Name: Default Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Name: admin Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Role: member,reader,admin Aug 24 14:34:33.705891 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Roles: member,reader,admin Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant: admin Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Name: admin Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User: admin Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Id: default Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Name: Default Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Name: admin Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: method: > Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: exception: Flavor 84 could not be found. Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: action_args: {'id': '84'} Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:33.707909 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:33.708945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:33.711000 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-81461646-2e41-4b20-aee6-593a272c2f4f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:33.712759 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-81461646-2e41-4b20-aee6-593a272c2f4f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014286 Aug 24 14:34:33.712759 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Aug 24 14:34:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:34.708424 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-4f64b379-910a-456e-be4f-3c20d55a94f5 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:34.709432 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-4f64b379-910a-456e-be4f-3c20d55a94f5 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 14:34:34.709826 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:35.281936 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d50f4fd5-e438-419b-9c31-a554d021c480 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:35.288208 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.wsgi [None req-d50f4fd5-e438-419b-9c31-a554d021c480 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d50f4fd5-e438-419b-9c31-a554d021c480 admin admin] Request method failure captured: Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept: application/json Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Accept-Encoding: gzip, deflate Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Connection: keep-alive Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Content-Length: 0 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Host: 10.222.0.90 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Openstack-System-Scope: None Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: User-Agent: python-novaclient Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Auth-Token: gAAAAABjBjb6dqEa4YUMOifMUuBP6OQhFKxyTo03n6lY3y8S2g52syX-YNROGneN0rlqWYZlAFiJyFIRkcDQN693fwB_Xf5RwYqYUoXBvG-VmVjMFgBjtZjL1ZTwiYVXOFDUpqBoqt28FDBe1TNOVYqaP77GAIydLp2cdDAIjDAzd6mHqhoA33I Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Id: None Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Domain-Name: None Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Identity-Status: Confirmed Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Is-Admin-Project: True Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Id: default Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Domain-Name: Default Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Project-Name: admin Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Role: member,reader,admin Aug 24 14:34:35.289745 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Roles: member,reader,admin Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant: admin Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-Tenant-Name: admin Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User: admin Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Id: default Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Domain-Name: Default Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: X-User-Name: admin Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: method: > Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: exception: Flavor 451 could not be found. Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: action_args: {'id': '451'} Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:35.291321 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:35.292837 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.294312 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d50f4fd5-e438-419b-9c31-a554d021c480 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:35.295718 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d50f4fd5-e438-419b-9c31-a554d021c480 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.445504 Aug 24 14:34:35.295718 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:34:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:35.301097 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-7cb4cf24-fd4b-402a-9ec1-739d60697d7f admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:35.316431 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-7cb4cf24-fd4b-402a-9ec1-739d60697d7f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018936 Aug 24 14:34:35.316971 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:35.329945 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:35.348999 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025288 Aug 24 14:34:35.349505 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Aug 24 14:34:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:34:35.358839 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-51f05c41-1e1d-4a66-b2e2-0ea1ecaca15b admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:35.364461 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.wsgi [None req-51f05c41-1e1d-4a66-b2e2-0ea1ecaca15b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-51f05c41-1e1d-4a66-b2e2-0ea1ecaca15b admin admin] Request method failure captured: Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept: application/json Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Accept-Encoding: gzip, deflate Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Connection: keep-alive Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Content-Length: 0 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Host: 10.222.0.90 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-Api-Version: compute 2.90 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Openstack-System-Scope: None Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: User-Agent: python-novaclient Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Auth-Token: gAAAAABjBjb6dqEa4YUMOifMUuBP6OQhFKxyTo03n6lY3y8S2g52syX-YNROGneN0rlqWYZlAFiJyFIRkcDQN693fwB_Xf5RwYqYUoXBvG-VmVjMFgBjtZjL1ZTwiYVXOFDUpqBoqt28FDBe1TNOVYqaP77GAIydLp2cdDAIjDAzd6mHqhoA33I Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Id: None Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Domain-Name: None Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Identity-Status: Confirmed Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Is-Admin-Project: True Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Id: default Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Domain-Name: Default Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Project-Name: admin Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Role: member,reader,admin Aug 24 14:34:35.365973 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Roles: member,reader,admin Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36659212b5af4eafbe0be679e7a1a2b5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36659212b5af4eafbe0be679e7a1a2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant: admin Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Id: 36659212b5af4eafbe0be679e7a1a2b5 Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-Tenant-Name: admin Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User: admin Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Id: default Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Domain-Name: Default Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Id: 0fe7ad543669428aa4738f9f4ac6bb19 Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: X-User-Name: admin Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: method: > Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: exception: Flavor 451 could not be found. Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: action_args: {'id': '451'} Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:35.367940 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:35.371958 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: ERROR nova.api.openstack.wsgi Aug 24 14:34:35.373049 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-51f05c41-1e1d-4a66-b2e2-0ea1ecaca15b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:35.374047 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-51f05c41-1e1d-4a66-b2e2-0ea1ecaca15b admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012059 Aug 24 14:34:35.374047 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:34:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 14:34:36.356603 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:36.357936 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 24 14:34:36.358350 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:36.909810 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-8724a18a-1005-4546-8c69-f50dd226b9ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:36.931275 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-8724a18a-1005-4546-8c69-f50dd226b9ca admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.436728 Aug 24 14:34:36.931825 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Aug 24 14:34:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:34:37.922356 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:37.923460 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 24 14:34:37.923861 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:38.475832 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-e7fff7d4-a8ae-4f9b-a693-6cb1fdae449e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:38.500303 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-e7fff7d4-a8ae-4f9b-a693-6cb1fdae449e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.438980 Aug 24 14:34:38.500869 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Aug 24 14:34:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:34:39.503365 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:39.504472 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 24 14:34:39.504895 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:40.054375 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-dbf2df6c-7cd7-406b-aac8-9e3c95a1a29f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:40.075036 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-dbf2df6c-7cd7-406b-aac8-9e3c95a1a29f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.433793 Aug 24 14:34:40.075563 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Aug 24 14:34:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:34:41.074074 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:41.075534 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Aug 24 14:34:41.075968 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:41.636335 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-f49b4a54-eb03-4241-8344-3052747cef68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:41.658058 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-f49b4a54-eb03-4241-8344-3052747cef68 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.439748 Aug 24 14:34:41.658623 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Aug 24 14:34:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:34:42.676958 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:42.678028 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 14:34:42.678426 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:43.270752 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-23aa86e3-1d70-4fab-bdbe-cf6607284740 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:43.293701 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-23aa86e3-1d70-4fab-bdbe-cf6607284740 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.471361 Aug 24 14:34:43.294414 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Aug 24 14:34:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:37.172338 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.173369 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-886c30c7-2986-48d2-8a35-61f8e64537be admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 14:35:37.173774 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 931 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:37.184362 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:37.599694 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-27d85aea-9eaf-4a35-8bc9-7f6e489a1443 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.620698 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-27d85aea-9eaf-4a35-8bc9-7f6e489a1443 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.440898 Aug 24 14:35:37.621254 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:37.641821 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG dbcounter [-] [112267] Writing DB stats nova_api:SELECT=14 {{(pid=112267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:37.645957 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-aedf9183-22a3-4aa1-b195-3ce3c40e9380 admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.653875 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-aedf9183-22a3-4aa1-b195-3ce3c40e9380 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013457 Aug 24 14:35:37.654716 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1283 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:37.666525 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-b0bd0de7-2ed0-41a2-83a7-f2465854196d admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.674658 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-b0bd0de7-2ed0-41a2-83a7-f2465854196d admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011758 Aug 24 14:35:37.675229 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1286 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:37.687033 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.694880 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011395 Aug 24 14:35:37.695331 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1286 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:37.706589 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-00fa8eaf-8b5d-475b-9fa7-c1655c6e79f4 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.714436 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-00fa8eaf-8b5d-475b-9fa7-c1655c6e79f4 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011339 Aug 24 14:35:37.715033 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1283 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:38.850257 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.851836 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002362 Aug 24 14:38:38.852485 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:38.996098 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_api:SELECT=6 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:39.246831 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:39.249948 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:38:39.249948 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:38:39.251298 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.251787 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.252241 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.253446 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.254170 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.254886 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.300253 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-00c84588-17bb-47b2-8506-d4a1c0dd1ab5 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.306286 Aug 24 14:38:39.300843 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 36/70] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:38:40.267128 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.268265 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Aug 24 14:38:40.268731 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:40.494085 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.497969 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:38:40.497969 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:38:40.500653 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.501728 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.502481 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.503807 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.505064 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.505788 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.531012 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-8f68762e-8093-4fbd-a951-b9d9dd47e538 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.115916 Aug 24 14:38:40.531866 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 37/72] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:38:51.804966 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.806011 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 14:38:51.806444 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 36/73] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:51.948393 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_cell0:SELECT=4 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:51.949093 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_cell1:SELECT=4 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:51.949688 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG dbcounter [-] [112268] Writing DB stats nova_api:SELECT=8 {{(pid=112268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:52.006962 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.009226 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:38:52.009226 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:38:52.010321 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.010823 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.011242 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.011948 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.012368 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.012772 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.038628 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-60c2f671-b7e9-4889-bbce-a822d6fc8efc admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094164 Aug 24 14:38:52.039172 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 38/74] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:52.880387 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: DEBUG nova.api.openstack.wsgi [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] Calling method '>' {{(pid=112267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.881401 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: INFO nova.api.openstack.requestlog [None req-d0c0f491-6f78-4cc3-a728-60913f95702f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 14:38:52.881806 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: [pid: 112267|app: 0|req: 37/75] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:53.075544 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG nova.api.openstack.wsgi [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Calling method '>' {{(pid=112268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.078028 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:38:53.078028 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: warnings.warn(msg) Aug 24 14:38:53.079148 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.079642 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.080088 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.080791 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.081231 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.081634 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: DEBUG oslo_concurrency.lockutils [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.102705 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: INFO nova.api.openstack.requestlog [None req-9e733347-88ee-410c-a8b9-355df2f39890 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084084 Aug 24 14:38:53.103179 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: [pid: 112268|app: 0|req: 39/76] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:51.726175 dv-cinder-848899-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 14:39:51.726801 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: Wed Aug 24 14:39:51 2022 - graceful shutdown triggered... Aug 24 14:39:51.727234 dv-cinder-848899-4-iscsi devstack@n-api.service[112267]: Gracefully killing worker 1 (pid: 112267)... Aug 24 14:39:51.731251 dv-cinder-848899-4-iscsi devstack@n-api.service[112268]: Gracefully killing worker 2 (pid: 112268)... Aug 24 14:39:52.728111 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: worker 1 buried after 1 seconds Aug 24 14:39:52.728111 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: worker 2 buried after 1 seconds Aug 24 14:39:52.728111 dv-cinder-848899-4-iscsi devstack@n-api.service[112255]: goodbye to uWSGI. Aug 24 14:39:52.730684 dv-cinder-848899-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 14:39:52.731596 dv-cinder-848899-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 14:39:52.735952 dv-cinder-848899-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:39:52.751461 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:39:52 2022] *** Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: nodename: dv-cinder-848899-4-iscsi Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: machine: x86_64 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: clock source: unix Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: pcre jit disabled Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: detected number of CPU cores: 4 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: current working directory: / Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: your processes number limit is 47680 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: your memory page size is 4096 bytes Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: detected max file descriptor number: 2048 Aug 24 14:39:52.754471 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: lock engine: pthread robust mutexes Aug 24 14:39:52.755516 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: thunder lock: enabled Aug 24 14:39:52.755516 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:39:52.755516 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:39:52.794487 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: Python main interpreter initialized at 0x56306fae69c0 Aug 24 14:39:52.794487 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: python threads support enabled Aug 24 14:39:52.794487 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: your server socket listen backlog is limited to 100 connections Aug 24 14:39:52.794487 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:39:52.794899 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:39:52.794899 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: *** Operational MODE: preforking *** Aug 24 14:39:52.795345 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:39:52.795345 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: spawned uWSGI master process (pid: 127278) Aug 24 14:39:52.795268 dv-cinder-848899-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:39:52.796776 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: spawned uWSGI worker 1 (pid: 127296, cores: 1) Aug 24 14:39:52.796776 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: spawned uWSGI worker 2 (pid: 127297, cores: 1) Aug 24 14:39:52.796776 dv-cinder-848899-4-iscsi devstack@n-api.service[127278]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:39:53.460922 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:39:53.461550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:39:54.601951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:39:54.601951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: from cryptography.utils import int_from_bytes Aug 24 14:39:54.602752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:39:54.602752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: from cryptography.utils import int_from_bytes Aug 24 14:39:54.602894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:39:54.602894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: from cryptography.utils import int_from_bytes Aug 24 14:39:54.602894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:39:54.602894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: from cryptography.utils import int_from_bytes Aug 24 14:39:56.969497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:39:56.969928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:39:56.970340 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:39:56.970747 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:39:56.971008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:39:56.971403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.971736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.972060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.972371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.972900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.973188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.973532 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.973859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.974198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.974447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.974815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.975149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-4-iscsi {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.975533 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.975835 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.976170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.976494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.976801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.977128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.977441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.977959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979704 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.979982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.980314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.980621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.981036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.981241 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.981670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-4-iscsi {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.981989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.982306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.982693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.983084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.983416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.983690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.984025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.984359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.984671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.985012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.985322 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.985648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.986344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.986717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.987037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.987354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.987687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.988045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.988358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.988613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.988925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.989254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.989579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.989907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.990163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.990417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.990766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.991120 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.991431 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.991741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.992052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.992360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.992668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.992975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.993281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.993589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.993909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.994228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.994575 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.994887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.995209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.995622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.995877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.996185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.996535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.996859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.997171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.997499 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.997823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.998251 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.998825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.999144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.999482 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:56.999858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.000170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.000425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.000730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.001039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.001365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.001677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.002001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.002292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.002622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.002937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.003244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.003553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.003860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.004168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.004477 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.004785 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.005092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.005399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.005728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.006053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.006363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.006841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.007155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.007472 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.007799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.008112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.008422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.008752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.009261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.009579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.009906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.010219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.010543 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.010876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.011187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.011495 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.011816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.012131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.012441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.012748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.013053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.013361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.013670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.013971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.014286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.014612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.014941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.015279 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.015576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.015883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.016190 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.016511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.017151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.017491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.017839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.018154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.018489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.018934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.018934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.019471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.019787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.020141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.020497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.020743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.021057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.021381 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.021703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.022039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.022404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.022756 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.023079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.023392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.023713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.024044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.024374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.024694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.025039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.025389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.025707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.026034 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.026360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.026703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.027017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.027331 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.027660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.027993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.028308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.028627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.028940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.029253 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.029563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.029874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.030243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.030531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.031078 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.031179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.031463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.031780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.032138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.032458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.032782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.033093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.033491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.033766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.034109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.034389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.034743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.035079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.035391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.035726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.036037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.036350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.037004 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.037004 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.037263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.037765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.038140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.038453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.038807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.039121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.039333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:39:57.039769 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.039854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:39:57.039926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.040100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.040320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:39:57.040427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.040645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.040741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:39:57.040958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.041119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:39:57.041270 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.041459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.041608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.041749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.041896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.042077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.042239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.042423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.042602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.042815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.042961 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.043206 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.043380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.043565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.043720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.043869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.044011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.044158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.044308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.044485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.044628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.044788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.044929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.045077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.045218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-4-iscsi {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.045365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.045513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.045665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.046901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.047075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.047221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.047365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.047505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.047654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.047848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.048009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.048159 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.048302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.048449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.048598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.048598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.048908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.049073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.049222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.049365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.049527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.049682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.049831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.049980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.050121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.050261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.050409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.050595 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.050743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.050892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.051071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.051211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.051364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.051523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.051672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.051812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.051959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.052107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.052263 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-4-iscsi {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.052412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.052412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.052686 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.052834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.052982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.053124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.053294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.053457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.053670 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.053818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.053972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.054114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.054253 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.054393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.054558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.054717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.054866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.055054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.055209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.055360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.055508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.055668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.055821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.055962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.056102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.056249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.056396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.056546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.056702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.056852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.057004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.057144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.057293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.057434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.057589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.057739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.057879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.058030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.058188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.058329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.058482 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.058678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.058828 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.058978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.059148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.059309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.059459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.059608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.059755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.059911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.060067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.060067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.060423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.060569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.060717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.060858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.061011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.061166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.061318 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.061458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.061597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.061743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.061891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.062041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.062189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.062336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.062476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.062652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.062811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.062969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.063117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.063300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.063441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.063596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.063786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.063933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.064075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.064225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.064365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.064513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.064673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.064821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.064980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.065122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.065262 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.065418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.065566 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.065715 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.065863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.066004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.066152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.066308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.066450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.066660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.066812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.066964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.067105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.067105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.067418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.067418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.067685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.067792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.067890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068024 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.068119 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068119 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.068380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.068570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068662 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.068662 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.068822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.068912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.069004 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.069089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.069179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.069310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.069397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.069506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.069620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.069819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.069926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.070155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.070305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.070409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.070545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.070773 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.070923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.071051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.071152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.071388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.071542 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.071664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.071765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.072002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.072154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.072264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.072354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.072602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.072758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.072862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.072957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.073189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.073288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.073507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.073628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.073824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.073918 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.074138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.074238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.074435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.074558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.074764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.074875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.075071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.075167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.075382 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.075492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.075690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.075794 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.075994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.076090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.076316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.076419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.076630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.076725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.076937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.077040 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.077244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.077352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.077542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.077741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.077894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.078037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.078233 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.078384 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.078586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.078737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.078915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.079059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.079215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.079364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.079506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.079691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.079836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.079976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.080154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.080297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.080437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.080588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.080730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.080890 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.081038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.081187 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.081329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.081501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.081673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.081824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.081974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.082123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.082272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.082422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.082601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.082759 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.082910 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.083051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.083264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.083457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.083614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.083899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.084048 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:39:57.084198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.084354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.084550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.084550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.084857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085700 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.085853 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086400 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.086933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.087995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088156 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088455 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.088891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089040 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089339 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.089989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.090893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.091092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.091236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.091573 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.091777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.091989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.092149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.092401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.092558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.092735 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.092880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.093954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094125 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094432 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.094978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095269 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.095992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.096194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.096323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.096503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.096821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.096974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.097168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.097331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.097497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.097763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.097959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098765 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.098940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.099097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.099252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.099394 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.099742 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.099899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100670 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.100993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.101734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.102854 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.103943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.104979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105459 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.105893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106034 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106173 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106649 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.106961 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.107961 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108274 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108745 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.108892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.109988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.110146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.110323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.110495 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.110705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.110862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111521 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111837 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.111994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.112949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.113862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.114860 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115322 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115826 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.115975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.116915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117686 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.117981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.118963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.119112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.119267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.119543 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.119706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.119865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.120931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121706 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.121872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122021 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.122969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123623 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.123933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124434 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.124893 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.125989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.126145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.126300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.126448 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.126630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.126859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.127937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128086 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128572 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.128877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129479 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.129951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.130929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131084 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131798 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.131951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.132875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133022 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133482 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.133942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134290 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134635 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.134951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135119 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.135896 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136514 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.136970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137724 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.137882 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.138984 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139450 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.139983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140771 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.140933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.141064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.141204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.141338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.141463 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.141921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.142909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.143866 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.144013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.144720 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.144859 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.144986 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.145932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146650 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.146909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147509 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147650 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.147919 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.148969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149095 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.149790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.150991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.151946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152080 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.152870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153023 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153472 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153649 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.153865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154263 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.154876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155002 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155533 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155667 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.155981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.156926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157064 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.157943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158710 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.158865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.159015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.159166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.159350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.159521 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.160358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.160522 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.160665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.160807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.160956 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161520 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.161920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.162195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.162327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.162701 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163099 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.163838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164430 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164747 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.164844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.165061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.165344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.165449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.165686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.165825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166254 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.166967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.167174 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.167329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.167588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.167744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.167959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.168117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.168256 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.168516 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.168653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.168845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.169048 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.169195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.169483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.169762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.169951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.170112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.170259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.170411 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.170562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.170888 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.171970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.172221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.172357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.172612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.172748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.172936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.173235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.173379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.173548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.173717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.173943 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.174237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.174393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.174915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.175809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176095 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.176984 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.177283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.177450 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.177592 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.177774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.177952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.178213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.178369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.178600 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.178751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.178917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.179154 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.179403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.179545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.179688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.179836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180075 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.180989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.181137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.181373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.181517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.181687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.181889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182641 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.182971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.183294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.183446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.183636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.184581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.184748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185581 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.185909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.186949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187085 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.187825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188339 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188339 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188611 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.188906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189322 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.189900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.190084 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.190272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.190738 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.190907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.190907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.191189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.191393 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.191530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.191736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.191871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.192058 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.192299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.192437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.192715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.192849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.193027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.193261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.193577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.193732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.193869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194904 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.194904 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.195957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196555 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.196923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197211 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.197946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.198089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.198237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.198237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.198741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.198881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199028 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.199890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200794 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.200942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.201110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.201348 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.201487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.201729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.201867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.202044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.202260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.202408 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.202706 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.202863 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.203017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.203190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.203437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.203709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.203878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.204128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.204266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.204427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.205356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.205523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.205675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.206928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.207675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.208421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.208711 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.208873 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209837 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.209989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.210848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.210990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211140 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211279 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.211833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212288 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212724 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.212871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213024 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.213644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.214887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.215036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.215185 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.215581 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.215734 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.215891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216274 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216274 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.216929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217078 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.217972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.218146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.218381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.218566 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.218853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219316 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.219908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220293 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220808 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.220948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.221230 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.221374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.221559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.221730 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.221885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.222179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.222316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.222494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.222712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.222850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.223100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.223237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.223439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.223584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.223772 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224530 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.224918 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.225075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.225290 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.225723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.225868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226325 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.226876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.227901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.228140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.228344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.228486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.228909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.229831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230624 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.230962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:39:57.231111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.231771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.231771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.232189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.232575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.232947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.233364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.233772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.234127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.234497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.234888 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.235275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.235905 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.236098 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.236478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.236865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.237259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.237677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.238030 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.238463 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.238794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.239163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.239532 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.239939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.240308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.240692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.241138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.241533 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.241910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.242314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.242729 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.243113 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.243494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.243883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.244256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.244623 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.244994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.245362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.245810 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.246193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.246497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.246889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.247256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.247625 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.248154 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.248377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.248760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.249619 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.249619 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.249962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.250252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.250666 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.251036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.251428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.251800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.252193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.252570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.253200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.253358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.253684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.254062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.254442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.254833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.255207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.255637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.256238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.256412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.257052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.257441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.257867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.258261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.258639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.259018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.259397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.259769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.260142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.260520 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.260892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.261280 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.261665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.262059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.262596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.262984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.263362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.263738 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.264115 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.264537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.264914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.265285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.265757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.266151 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.266931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.267227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.267602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.267980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.268396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.268795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.269176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.269557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.269935 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.270322 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.271014 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.276970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.276970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.276970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.276970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.278735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.279144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.279539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.279970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.280381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.280778 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.281168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.281575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.282409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.282409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.282995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.282995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.283453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.283844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.284238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.284792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.285213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.285578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.286354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.287261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.287261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.287729 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.288078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.288352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.288741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.289110 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.289492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.289868 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.290257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.290712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.291087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.291444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.291818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.292256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.292486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Registered counter for database nova_api Aug 24 14:39:57.292698 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.293132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.293448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.293829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.294207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.299378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.300801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.300801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.302339 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.302785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.303188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.303644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.304042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.304466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.304854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.305282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.306298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.306298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.306298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.306838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.307219 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.307648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.309885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.309885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.309885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.310438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.310962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.311588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.312192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.312757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.313355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.313704 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.313988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.314432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.314872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.315261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.315778 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.316170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.316760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.317082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.317494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.317907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.318315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.318785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.319227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.320131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.320131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.320481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.320652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.321004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.321427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.321844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.322262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.322695 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.323103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.323510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.323916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.324321 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.324732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.325158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.325569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.325969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.326492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.326916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.327327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.327739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.328140 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.328553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.328969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.329373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.329865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.330322 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.330672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.331102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.331543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.331969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.332364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.332762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.333158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.333558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.333965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.334366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.334838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.335236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.335638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.336032 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.336426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.336835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.337231 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.337628 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.338037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.338419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.338833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.339227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.339704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.340027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.340468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.340787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.341177 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.341568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.342015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.342408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.342845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.343270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.343675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.344088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.344491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.344903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.345302 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.345712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.346125 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.347004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.347004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.347438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.347840 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.348246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.348747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.349128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.349477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.349882 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.350480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.350925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.351136 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.351564 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.351977 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.352387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.352792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.353190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.353610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.354009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.354406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.354819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.355220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.355617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.356020 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.356417 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.356829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.357232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.357637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.358050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.358465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.358959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.359372 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.359798 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.360460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.360872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.361317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.361788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.362425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.362865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.363263 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:39:57.363596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:39:57.376875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.context [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),018ea49c-ac3d-448e-85b1-659198c7a196(cell1) {{(pid=127297) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:39:57.381029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:57.381489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:57.383143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:57.383875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:57.384325 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:57.386288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:57.388336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Registered counter for database nova_cell0 Aug 24 14:39:57.392833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Registered counter for database nova_cell1 Aug 24 14:39:57.400188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.403276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.408019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.410534 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.432429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO dbcounter [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Registered counter for database nova_api Aug 24 14:39:57.453813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_db.sqlalchemy.engines [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.461129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writer thread running {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.517391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.context [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),018ea49c-ac3d-448e-85b1-659198c7a196(cell1) {{(pid=127296) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:39:57.521383 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:57.521851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:57.523523 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:57.524240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:57.524670 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:57.526674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:57.528667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO dbcounter [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Registered counter for database nova_cell0 Aug 24 14:39:57.532696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO dbcounter [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Registered counter for database nova_cell1 Aug 24 14:39:57.539954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_db.sqlalchemy.engines [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.541329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_db.sqlalchemy.engines [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.547766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writer thread running {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.549354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writer thread running {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.557281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Registered counter for database nova_cell0 Aug 24 14:39:57.564301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.569165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.696689 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO dbcounter [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Registered counter for database nova_cell0 Aug 24 14:39:57.703595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_db.sqlalchemy.engines [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:39:57.709939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writer thread running {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:39:57.885370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:39:57.892987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:39:58.027908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: WARNING keystonemiddleware.auth_token [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:39:58.035270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: WARNING keystonemiddleware.auth_token [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:39:58.229310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:39:58.235683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-29928f00-4cda-4a3a-ab66-aade3e0dfae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:39:58.241270 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56306fae69c0 pid: 127297 (default app) Aug 24 14:39:58.373755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: WARNING keystonemiddleware.auth_token [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:39:58.379755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: WARNING keystonemiddleware.auth_token [None req-e9092770-7a9a-460e-b6fa-aabdf13614b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:39:58.385098 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56306fae69c0 pid: 127296 (default app) Aug 24 14:40:34.563357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.565301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.566208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.567154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.709115 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.710252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.711179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:34.712155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:35.556353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-131e2436-a571-4417-8e51-364637e509fb tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Action: 'create', calling method: .version_select at 0x7f874bb048b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1006891555", "metadata": {"Type": "work"}}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:35.755387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bb9edeca-917d-462c-abcb-f160f078561d tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Action: 'create', calling method: .version_select at 0x7f874bb038b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-301207035"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:37.181571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bb9edeca-917d-462c-abcb-f160f078561d tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.478091 Aug 24 14:40:37.182876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1155 bytes} [Wed Aug 24 14:40:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2481 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:40:37.188495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-921039d7-8fe7-47a3-97a3-f55b94ba1900 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b95b700>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:37.278815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-131e2436-a571-4417-8e51-364637e509fb tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.723525 Aug 24 14:40:37.281060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 1/2] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Aug 24 14:40:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2728 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:40:37.287661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9c133d95-2627-41ab-b5cd-db7cabbf467d tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95c700>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:37.394144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-921039d7-8fe7-47a3-97a3-f55b94ba1900 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/43b70cd2-f7ca-4871-8356-97d17e9dbe7b" status: 200 len: 351 microversion: 2.1 time: 0.209695 Aug 24 14:40:37.395829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 2/3] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:37 2022] GET /compute/v2.1/os-volumes/43b70cd2-f7ca-4871-8356-97d17e9dbe7b => generated 351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:37.408582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-813adeaf-6fb7-4064-9ba8-402314fc5caa tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b95be50>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:37.527905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9c133d95-2627-41ab-b5cd-db7cabbf467d tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 200 len: 344 microversion: 2.1 time: 0.245293 Aug 24 14:40:37.528460 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 2/4] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:37 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 344 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:37.738855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-813adeaf-6fb7-4064-9ba8-402314fc5caa tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 353 microversion: 2.1 time: 0.340838 Aug 24 14:40:37.739786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 3/5] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:37 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 353 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:38.557029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f29ed331-11d4-4c7e-8d03-823377b0fecf tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95ce50>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:38.671420 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f29ed331-11d4-4c7e-8d03-823377b0fecf tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 200 len: 345 microversion: 2.1 time: 0.127979 Aug 24 14:40:38.683651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 3/6] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:38 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:38.685202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cf731fad-ccf2-4a8a-bbec-0d831079ea9e tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Action: 'create', calling method: .version_select at 0x7f874b975550>, body: {"snapshot": {"volume_id": "9ec19875-2c95-400a-9c70-682495660a8e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-303604723"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:38.756502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b5c79e3-eda2-4b3a-a476-36b29df02cc6 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b975550>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.024890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b5c79e3-eda2-4b3a-a476-36b29df02cc6 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 354 microversion: 2.1 time: 0.274882 Aug 24 14:40:39.034397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 4/7] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:38 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:39.047218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e5d8b227-2199-49b6-ad70-7289ceab472f tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b95cc10>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.238580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e5d8b227-2199-49b6-ad70-7289ceab472f tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 354 microversion: 2.1 time: 0.201950 Aug 24 14:40:39.239748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 5/8] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:39.253640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9a40e01a-dacc-48a2-a7a4-c42c78c5f344 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b95c550>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.446958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cf731fad-ccf2-4a8a-bbec-0d831079ea9e tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.765609 Aug 24 14:40:39.453858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 4/9] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Aug 24 14:40:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:39.468709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fbc40340-e098-4c08-9012-4b287915aab9 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b975e50>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.574917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9a40e01a-dacc-48a2-a7a4-c42c78c5f344 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 202 len: 0 microversion: 2.1 time: 0.326275 Aug 24 14:40:39.575493 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 6/10] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:40:39 2022] DELETE /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:39.580971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-58f62cee-eb75-428a-a36f-1d0f5e913bf7 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b975280>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.670773 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fbc40340-e098-4c08-9012-4b287915aab9 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/e9f2bd6a-e4f0-42bd-a820-811a53f2ea89" status: 200 len: 351 microversion: 2.1 time: 0.221164 Aug 24 14:40:39.671656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 5/11] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/os-volumes/e9f2bd6a-e4f0-42bd-a820-811a53f2ea89 => generated 351 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:39.679354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5cd87017-990b-4bf1-8151-3e5984305602 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b975430>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.711720 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-58f62cee-eb75-428a-a36f-1d0f5e913bf7 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 286 microversion: 2.1 time: 0.134300 Aug 24 14:40:39.712317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 7/12] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:39.725565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9aa0402-db47-4c13-88ef-d6dc386910d9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95c4c0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:40.183013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5cd87017-990b-4bf1-8151-3e5984305602 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 353 microversion: 2.1 time: 0.510066 Aug 24 14:40:40.183706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 6/13] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 353 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:40.331451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9aa0402-db47-4c13-88ef-d6dc386910d9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.611286 Aug 24 14:40:40.344343 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 8/14] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:40.376309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-919c3280-8053-496b-9481-7ee92876ae43 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95bb80>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:40.472179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-919c3280-8053-496b-9481-7ee92876ae43 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 286 microversion: 2.1 time: 0.126097 Aug 24 14:40:40.479015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 7/15] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:40 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:41.198119 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6df43d82-7f6d-464e-a541-5b445f3b7744 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b975670>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:41.308009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6df43d82-7f6d-464e-a541-5b445f3b7744 tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 353 microversion: 2.1 time: 0.114180 Aug 24 14:40:41.308699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 9/16] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:41 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:41.485059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9ba3356f-dd60-422b-bef7-4c82b431eb8b tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b9753a0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:41.640607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9ba3356f-dd60-422b-bef7-4c82b431eb8b tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 286 microversion: 2.1 time: 0.159490 Aug 24 14:40:41.644076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 8/17] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:41 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:42.322644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4c5fdb6e-3279-4e89-9478-efd2c909e4ff tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b9810d0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.423933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4c5fdb6e-3279-4e89-9478-efd2c909e4ff tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 353 microversion: 2.1 time: 0.105319 Aug 24 14:40:42.430195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 10/18] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:42.655082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5ac655bb-4c6f-4738-941a-e400215d0175 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b975ca0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.768294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5ac655bb-4c6f-4738-941a-e400215d0175 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 286 microversion: 2.1 time: 0.118552 Aug 24 14:40:42.777804 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 9/19] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:43.444806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-594660e4-09d0-4a0e-a36c-ee60a8fec88c tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b975c10>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.574996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-594660e4-09d0-4a0e-a36c-ee60a8fec88c tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 200 len: 353 microversion: 2.1 time: 0.139040 Aug 24 14:40:43.576124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 11/20] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:43.801747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-554ed084-d8fc-4a93-a062-cb0b203b9a46 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95b820>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.828480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a7421c2a-37ae-46a0-8673-1a6e83b4dfee tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b975160>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.885457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-554ed084-d8fc-4a93-a062-cb0b203b9a46 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 287 microversion: 2.1 time: 0.100254 Aug 24 14:40:43.887091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 10/21] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:43.898785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ff54e7cc-6089-41a2-aa42-9d2786231db9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874bb03dc0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.030256 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a7421c2a-37ae-46a0-8673-1a6e83b4dfee tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/d11fc742-d1a8-461b-b98b-b3ae7e09e373" status: 200 len: 350 microversion: 2.1 time: 0.206784 Aug 24 14:40:44.040387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 12/22] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/os-volumes/d11fc742-d1a8-461b-b98b-b3ae7e09e373 => generated 350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:44.047375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6db46fa9-9e0a-4491-b8c7-a63e7e3831e1 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b95cd30>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.166466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ff54e7cc-6089-41a2-aa42-9d2786231db9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 202 len: 0 microversion: 2.1 time: 0.270284 Aug 24 14:40:44.167754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 11/23] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Aug 24 14:40:43 2022] DELETE /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:44.177580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bc96e7ba-a66f-4fac-9bf8-e1e600357358 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b95bee0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.343568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6db46fa9-9e0a-4491-b8c7-a63e7e3831e1 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.301288 Aug 24 14:40:44.344774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 13/24] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:44.368960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d68e53fe-8d34-4ef8-94ba-b6b8864137b8 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b95cee0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.394010 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bc96e7ba-a66f-4fac-9bf8-e1e600357358 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 200 len: 286 microversion: 2.1 time: 0.221754 Aug 24 14:40:44.399855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 12/25] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:44.589842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3fa8ae9e-6046-4343-9aea-03f76ae509fd tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Calling method '.version_select at 0x7f874b95b790>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.619897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d68e53fe-8d34-4ef8-94ba-b6b8864137b8 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.259223 Aug 24 14:40:44.620935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 14/26] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:44.637234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a191826c-e293-4055-8fc6-21f9bc1b956d tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b975b80>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.661354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-3fa8ae9e-6046-4343-9aea-03f76ae509fd tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] HTTP exception thrown: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3fa8ae9e-6046-4343-9aea-03f76ae509fd tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Request method failure captured: Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 HTTP/1.1 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhimBSVie4Gm4miHtVcUv-S4vQK3F1huXk_FI9AKJ_GBPSH_OkVloKCSTa1Ty7EL0V-l1e2HCH7WBsyxHgVobtDAhUecApTZgGydySiykI4reU1Od8C6b-PpH6O_S9GQwgCRZGwQBFwhuvS5k6RofWIKAkMHpy2em5AG3ekAa203uU Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 4f2cebc24d7645bdbcd31ca26adfea58 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesGetTestJSON-533531211 Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:44.665914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4f2cebc24d7645bdbcd31ca26adfea58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f2cebc24d7645bdbcd31ca26adfea58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f2cebc24d7645bdbcd31ca26adfea58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4f2cebc24d7645bdbcd31ca26adfea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesGetTestJSON-533531211 Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 4f2cebc24d7645bdbcd31ca26adfea58 Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesGetTestJSON-533531211 Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesGetTestJSON-533531211-project Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: e1f986349a0b46b381d2691e8e96cfac Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesGetTestJSON-533531211-project Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'ec383094-3d01-4695-8805-dc96bbf39035'} Aug 24 14:40:44.667086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. (HTTP 404) (Request-ID: req-118bf63d-11ca-49c8-a977-8daa314768ca) Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:44.667898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:44.669822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:40:44.671894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3fa8ae9e-6046-4343-9aea-03f76ae509fd tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] Returning 404 to user: Volume ec383094-3d01-4695-8805-dc96bbf39035 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3fa8ae9e-6046-4343-9aea-03f76ae509fd tempest-VolumesGetTestJSON-533531211 tempest-VolumesGetTestJSON-533531211-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035" status: 404 len: 109 microversion: 2.1 time: 0.082156 Aug 24 14:40:44.675047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 13/27] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-volumes/ec383094-3d01-4695-8805-dc96bbf39035 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:40:44.803707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a191826c-e293-4055-8fc6-21f9bc1b956d tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.170607 Aug 24 14:40:44.814890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 15/28] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:44.818474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-73f48da6-eac2-4423-adab-fb3daee3e908 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b8e30d0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.078608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-73f48da6-eac2-4423-adab-fb3daee3e908 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.264094 Aug 24 14:40:45.079360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 14/29] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:45.095056 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-10105ff4-e2dd-4c4f-b426-2bedbefec73f tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b981d30>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.342874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-10105ff4-e2dd-4c4f-b426-2bedbefec73f tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.251647 Aug 24 14:40:45.346314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 16/30] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:45.360964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d7764901-ff56-45da-919b-4b4fbc2ab047 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b8ed280>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.416479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9d1ba5e-6222-4dfd-b3e4-a02922838bdb tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b981430>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.461554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-f9d1ba5e-6222-4dfd-b3e4-a02922838bdb tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] HTTP exception thrown: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9d1ba5e-6222-4dfd-b3e4-a02922838bdb tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Request method failure captured: Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd HTTP/1.1 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhiua6uzPuAJgF-hw_Ns8I3yV7wKrDbQVCikwKUYbk2YzMYBHwaz1kgyxc3zBpxmXgCHNATtfSf6bYDlWCFys9Uxa-WxqGf6TLs_u9Dn5JmlZ-oXKHAG8CWJSOKJLQqYAMwe5Xae53GwUUjkk-m9yJI8Ipu9P8AsDi-XzMzYoGsaIg Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:40:45.470263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df1e711e73144bb1a2bd2a71452ec2d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 58e72b1e3d5648739aad9c0dc9f7e751 Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '3106f6e7-55f7-4641-a956-98d8dd61cdbd'} Aug 24 14:40:45.471605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. (HTTP 404) (Request-ID: req-a61cd3ac-c93b-4ddd-9ad5-e40f84f43fa8) Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.472451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:45.473513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 14:40:45.474812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. Aug 24 14:40:45.475940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:45.477141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9d1ba5e-6222-4dfd-b3e4-a02922838bdb tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Returning 404 to user: Snapshot 3106f6e7-55f7-4641-a956-98d8dd61cdbd could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:45.478975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f9d1ba5e-6222-4dfd-b3e4-a02922838bdb tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd" status: 404 len: 111 microversion: 2.1 time: 0.075014 Aug 24 14:40:45.487369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 17/31] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-snapshots/3106f6e7-55f7-4641-a956-98d8dd61cdbd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:45.501758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2e7871b5-035a-4048-96ab-966b492b09e8 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b9818b0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.590183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d7764901-ff56-45da-919b-4b4fbc2ab047 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.233898 Aug 24 14:40:45.591518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 15/32] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:45.618660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5fb92261-3d1f-4a72-be07-8d1028718a03 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b8ed940>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.676609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2e7871b5-035a-4048-96ab-966b492b09e8 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 202 len: 0 microversion: 2.1 time: 0.186524 Aug 24 14:40:45.682758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 18/33] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:40:45 2022] DELETE /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:45.707457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-385a4e4a-6988-4863-99ba-ebfc56bcd8d5 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b981b80>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.842980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5fb92261-3d1f-4a72-be07-8d1028718a03 tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.233394 Aug 24 14:40:45.843627 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 16/34] 10.222.0.90 () {58 vars in 1188 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:45.848208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-385a4e4a-6988-4863-99ba-ebfc56bcd8d5 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 200 len: 344 microversion: 2.1 time: 0.162630 Aug 24 14:40:45.849667 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 19/35] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:45.861411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-20b28d02-366f-460b-8deb-8b8de12202ec tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] Calling method '.version_select at 0x7f874b8e33a0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:46.097402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-20b28d02-366f-460b-8deb-8b8de12202ec tempest-VolumesTestJSON-1312123638 tempest-VolumesTestJSON-1312123638-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.243872 Aug 24 14:40:46.098643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 17/36] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:46.865592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bd5cde31-c2d7-4d6f-9d8e-0eb75ec744b0 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b8f25e0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:47.002066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bd5cde31-c2d7-4d6f-9d8e-0eb75ec744b0 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 200 len: 344 microversion: 2.1 time: 0.142371 Aug 24 14:40:47.002924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 18/37] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:46 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:47.263613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-310934786", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:47.454665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] validate_networks() for [('acfa551b-70ba-4d4e-abd4-a205f44489e0', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:48.016824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fd198b46-e998-4062-88d3-cc44cb77fa05 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b8edf70>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:48.157641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fd198b46-e998-4062-88d3-cc44cb77fa05 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 200 len: 344 microversion: 2.1 time: 0.144611 Aug 24 14:40:48.164121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 19/38] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:48 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:49.176185 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b9f5fa48-8c74-4139-bd29-21cecf1cb2d6 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b8ed310>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.307250 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-b9f5fa48-8c74-4139-bd29-21cecf1cb2d6 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] HTTP exception thrown: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b9f5fa48-8c74-4139-bd29-21cecf1cb2d6 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Request method failure captured: Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e HTTP/1.1 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhiua6uzPuAJgF-hw_Ns8I3yV7wKrDbQVCikwKUYbk2YzMYBHwaz1kgyxc3zBpxmXgCHNATtfSf6bYDlWCFys9Uxa-WxqGf6TLs_u9Dn5JmlZ-oXKHAG8CWJSOKJLQqYAMwe5Xae53GwUUjkk-m9yJI8Ipu9P8AsDi-XzMzYoGsaIg Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:49.315930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df1e711e73144bb1a2bd2a71452ec2d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 58e72b1e3d5648739aad9c0dc9f7e751 Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '9ec19875-2c95-400a-9c70-682495660a8e'} Aug 24 14:40:49.317166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. (HTTP 404) (Request-ID: req-3645c686-916b-41f5-b2a4-cdac2d655687) Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.317807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:49.318929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:40:49.319786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.320674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.323072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b9f5fa48-8c74-4139-bd29-21cecf1cb2d6 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Returning 404 to user: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:49.325405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b9f5fa48-8c74-4139-bd29-21cecf1cb2d6 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 404 len: 109 microversion: 2.1 time: 0.153668 Aug 24 14:40:49.326158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 20/39] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:49 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:49.349612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b6c18846-11a3-4a31-9377-cb609d202af9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b8ed790>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.449643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-b6c18846-11a3-4a31-9377-cb609d202af9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] HTTP exception thrown: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b6c18846-11a3-4a31-9377-cb609d202af9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Request method failure captured: Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e HTTP/1.1 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhiua6uzPuAJgF-hw_Ns8I3yV7wKrDbQVCikwKUYbk2YzMYBHwaz1kgyxc3zBpxmXgCHNATtfSf6bYDlWCFys9Uxa-WxqGf6TLs_u9Dn5JmlZ-oXKHAG8CWJSOKJLQqYAMwe5Xae53GwUUjkk-m9yJI8Ipu9P8AsDi-XzMzYoGsaIg Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:49.451569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df1e711e73144bb1a2bd2a71452ec2d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 58e72b1e3d5648739aad9c0dc9f7e751 Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '9ec19875-2c95-400a-9c70-682495660a8e'} Aug 24 14:40:49.452832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. (HTTP 404) (Request-ID: req-13af58e2-18f4-4062-b5eb-6653bd0c6bd1) Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:49.454407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:40:49.456327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.458324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.471261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b6c18846-11a3-4a31-9377-cb609d202af9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Returning 404 to user: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:49.472477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b6c18846-11a3-4a31-9377-cb609d202af9 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 404 len: 109 microversion: 2.1 time: 0.136241 Aug 24 14:40:49.474940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 21/40] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:40:49 2022] DELETE /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:49.490134 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9b347763-b56e-447b-b824-cf80bd70c200 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Calling method '.version_select at 0x7f874b975040>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.581065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-9b347763-b56e-447b-b824-cf80bd70c200 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] HTTP exception thrown: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9b347763-b56e-447b-b824-cf80bd70c200 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Request method failure captured: Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e HTTP/1.1 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhiua6uzPuAJgF-hw_Ns8I3yV7wKrDbQVCikwKUYbk2YzMYBHwaz1kgyxc3zBpxmXgCHNATtfSf6bYDlWCFys9Uxa-WxqGf6TLs_u9Dn5JmlZ-oXKHAG8CWJSOKJLQqYAMwe5Xae53GwUUjkk-m9yJI8Ipu9P8AsDi-XzMzYoGsaIg Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:49.584643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df1e711e73144bb1a2bd2a71452ec2d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df1e711e73144bb1a2bd2a71452ec2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: df1e711e73144bb1a2bd2a71452ec2d6 Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474305609 Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 58e72b1e3d5648739aad9c0dc9f7e751 Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474305609-project Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '9ec19875-2c95-400a-9c70-682495660a8e'} Aug 24 14:40:49.586214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. (HTTP 404) (Request-ID: req-fa92b294-fad3-4929-9d75-cb19831680ab) Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.587081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:49.588205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:40:49.589731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. Aug 24 14:40:49.591576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:49.594534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9b347763-b56e-447b-b824-cf80bd70c200 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] Returning 404 to user: Volume 9ec19875-2c95-400a-9c70-682495660a8e could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:49.594957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9b347763-b56e-447b-b824-cf80bd70c200 tempest-VolumesSnapshotsTestJSON-474305609 tempest-VolumesSnapshotsTestJSON-474305609-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e" status: 404 len: 109 microversion: 2.1 time: 0.114133 Aug 24 14:40:49.596565 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 22/41] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:49 2022] GET /compute/v2.1/os-volumes/9ec19875-2c95-400a-9c70-682495660a8e => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:50.575661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:50.576217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:50.576620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:50.577017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:50.577498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:50.631610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.632096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.635060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.639091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.639959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.640548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.737562 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:50.745445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-520e69c0-fb7b-4756-b044-e1d9347a427d tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Action: 'create', calling method: .version_select at 0x7f874b9758b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1989448324", "metadata": {"Type": "work"}}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:50.755133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for user 9cef72df53e14cc39db936f6737d842c and project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-520e69c0-fb7b-4756-b044-e1d9347a427d tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 122 Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:50.756820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1989448324", "metadata": {"Type": "work"}}} Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:50.758003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1989448324', 'metadata': {'Type': 'work'}}}} Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:50.758741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:40:50.759857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:40:50.760805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:40:50.760805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.762458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-520e69c0-fb7b-4756-b044-e1d9347a427d tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:50.769617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-520e69c0-fb7b-4756-b044-e1d9347a427d tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.021715 Aug 24 14:40:50.771056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 23/42] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Aug 24 14:40:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1031 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:40:50.789220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-251abe63-0674-4b68-a3e7-5e531c6786a8 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Action: 'create', calling method: .version_select at 0x7f874b8f29d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1007959434", "metadata": {"Type": "work"}}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-251abe63-0674-4b68-a3e7-5e531c6786a8 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 120 Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:50.793124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1007959434", "metadata": {"Type": "work"}}} Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:50.794355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1007959434', 'metadata': {'Type': 'work'}}}} Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi '0' Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:50.795248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:40:50.796614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:40:50.797679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:40:50.797679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.798321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:50.800036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-251abe63-0674-4b68-a3e7-5e531c6786a8 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:50.800885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-251abe63-0674-4b68-a3e7-5e531c6786a8 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022673 Aug 24 14:40:50.807436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 24/43] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Aug 24 14:40:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:40:50.809569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:50.818637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-42614d85-4cd1-464c-9ae1-26dd793fe6a5 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Action: 'create', calling method: .version_select at 0x7f874b8f2310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1508362234", "metadata": {"Type": "work"}}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-42614d85-4cd1-464c-9ae1-26dd793fe6a5 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 119 Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:50.822354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1508362234", "metadata": {"Type": "work"}}} Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:50.823460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1508362234', 'metadata': {'Type': 'work'}}}} Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi '' Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:50.824109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:40:50.825232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:40:50.826200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:40:50.826200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.836678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-42614d85-4cd1-464c-9ae1-26dd793fe6a5 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:50.837349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-42614d85-4cd1-464c-9ae1-26dd793fe6a5 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025901 Aug 24 14:40:50.849694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 25/44] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Aug 24 14:40:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:40:50.862561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8e476110-a9ac-4fc7-9c68-5c3a879928e3 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Calling method '.version_select at 0x7f874b8edee0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:50.937274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-8e476110-a9ac-4fc7-9c68-5c3a879928e3 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] HTTP exception thrown: Volume tempest-invalid-1525030064 could not be found. Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8e476110-a9ac-4fc7-9c68-5c3a879928e3 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1525030064 HTTP/1.1 Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:40:50.939410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Volume tempest-invalid-1525030064 could not be found. Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'tempest-invalid-1525030064'} Aug 24 14:40:50.940645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1525030064 could not be found. (HTTP 404) (Request-ID: req-1299da43-cea7-4dd3-883c-8091af200080) Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.941444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:50.943693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1525030064 could not be found. Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:50.944757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1525030064 could not be found. Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1525030064 could not be found. Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8e476110-a9ac-4fc7-9c68-5c3a879928e3 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 404 to user: Volume tempest-invalid-1525030064 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8e476110-a9ac-4fc7-9c68-5c3a879928e3 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1525030064" status: 404 len: 99 microversion: 2.1 time: 0.088855 Aug 24 14:40:50.945821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 26/45] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Aug 24 14:40:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1525030064 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:40:50.950998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5dc66fe7-68a7-412d-b61a-87bf71644ace tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004211 Aug 24 14:40:50.961245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 27/46] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Aug 24 14:40:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:40:50.972944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-39645d95-3933-4c53-b0df-925e073839c5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.377773 Aug 24 14:40:50.976389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-43a3c2aa-d9fa-48b5-a242-52c4782f15de tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011708 Aug 24 14:40:50.978112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 20/47] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:40:50.982917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 28/48] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Aug 24 14:40:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:40:50.994383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a436d726-fc29-415b-82fb-b74d113e3958 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Calling method '.version_select at 0x7f874afe44c0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.010951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3ea39239-3599-450f-abd6-1f792670e2d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.031043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3ea39239-3599-450f-abd6-1f792670e2d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:51.066014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-a436d726-fc29-415b-82fb-b74d113e3958 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] HTTP exception thrown: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a436d726-fc29-415b-82fb-b74d113e3958 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/os-volumes/40c19799-e79d-4e6c-b8ad-ba9bba485a30 HTTP/1.1 Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:40:51.069242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '40c19799-e79d-4e6c-b8ad-ba9bba485a30'} Aug 24 14:40:51.072291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. (HTTP 404) (Request-ID: req-05c04779-2888-4e93-8ae0-dcb8739c7d55) Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.072946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:40:51.073828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:40:51.079386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a436d726-fc29-415b-82fb-b74d113e3958 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 404 to user: Volume 40c19799-e79d-4e6c-b8ad-ba9bba485a30 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a436d726-fc29-415b-82fb-b74d113e3958 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/40c19799-e79d-4e6c-b8ad-ba9bba485a30" status: 404 len: 109 microversion: 2.1 time: 0.083586 Aug 24 14:40:51.085838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 21/49] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:40:50 2022] DELETE /compute/v2.1/os-volumes/40c19799-e79d-4e6c-b8ad-ba9bba485a30 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:40:51.095545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28e6f351-e27d-469a-83a9-bd08ca28b8f0 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Calling method '.version_select at 0x7f874b9813a0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.171338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-28e6f351-e27d-469a-83a9-bd08ca28b8f0 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] HTTP exception thrown: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28e6f351-e27d-469a-83a9-bd08ca28b8f0 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Request method failure captured: Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-volumes/2fb8a50f-616a-499e-aeb6-779ce710d60a HTTP/1.1 Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhxfEcdxuTT3NUU83-a4fyNQmcTeVplc0I6kVSyUu2VjUwZKOH45_ZOBlLhnOhnhLggrk1SrKc_qFz4UCFxYi8zm36HCILx3s2Tu0wPn9_gguUYRdDYoOKzDTUZA-kqNS_bj4NYa3hxL723kbZJ-H-EHsWYI9j4650A_c8LOMOIabA Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:40:51.173502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fc8a88ec407c403a8e9baf6ae93002aa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fc8a88ec407c403a8e9baf6ae93002aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: fc8a88ec407c403a8e9baf6ae93002aa Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-908841380 Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: cc41272d5cc940f39dde5dfa9717928b Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-908841380-project Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '2fb8a50f-616a-499e-aeb6-779ce710d60a'} Aug 24 14:40:51.174565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. (HTTP 404) (Request-ID: req-9e3dd387-7d7e-49c7-9b61-898d16510e3d) Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.175223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:40:51.177097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:40:51.179478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28e6f351-e27d-469a-83a9-bd08ca28b8f0 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] Returning 404 to user: Volume 2fb8a50f-616a-499e-aeb6-779ce710d60a could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:51.181738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-28e6f351-e27d-469a-83a9-bd08ca28b8f0 tempest-VolumesNegativeTest-908841380 tempest-VolumesNegativeTest-908841380-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/2fb8a50f-616a-499e-aeb6-779ce710d60a" status: 404 len: 109 microversion: 2.1 time: 0.097704 Aug 24 14:40:51.186150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 22/50] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Aug 24 14:40:51 2022] GET /compute/v2.1/os-volumes/2fb8a50f-616a-499e-aeb6-779ce710d60a => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:51.297645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3ea39239-3599-450f-abd6-1f792670e2d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:51.347791 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3ea39239-3599-450f-abd6-1f792670e2d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1221 microversion: 2.1 time: 0.343752 Aug 24 14:40:51.371410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 29/51] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:50 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1221 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:52.468616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-26081c2d-c7d5-427a-a2c4-34d7f30869f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: .version_select at 0x7f874afe40d0>, body: {"keypair": {"name": "tempest-keypair-1519180671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoXrAF44shEbqiwtMZ6O2ssY7Z+DCWYXU0NdekNmkQwXnB7OZc37GUT6gziSai5ayQPh45UgctZJRip76FPEwxhaJAPCm4Uh9MM3onlm3S/qHZnOYCzg21zKM6XoaJ+GQ=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:52.546652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-128485172", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "networks": [{"uuid": "5146729c-8283-4e51-ac88-4581f25fc689"}]}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:52.556619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-26081c2d-c7d5-427a-a2c4-34d7f30869f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:52.570648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-26081c2d-c7d5-427a-a2c4-34d7f30869f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for user 1623364d853c42a88a7172adfa07ef89 and project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:52.652957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-26081c2d-c7d5-427a-a2c4-34d7f30869f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.386348 Aug 24 14:40:52.654022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 23/52] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:40:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:52.682252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-113147027", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:52.852221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] validate_networks() for [('acfa551b-70ba-4d4e-abd4-a205f44489e0', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:52.874362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] validate_networks() for [('5146729c-8283-4e51-ac88-4581f25fc689', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:54.643106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:54.643610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:54.644077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:54.644414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:54.644901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:54.662992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.663510 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.663955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.664699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.665157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.665582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.714663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:54.721270 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for user 9cef72df53e14cc39db936f6737d842c and project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:54.761342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:54.763960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:54.870653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fb21f739-8186-4b1a-89cd-3389c0a10df1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.213975 Aug 24 14:40:54.872986 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 24/53] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:40:54.903447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b7dfa25-9f4f-40c3-8b75-63a9dd939e91 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:54.907375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3b7dfa25-9f4f-40c3-8b75-63a9dd939e91 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:55.183096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b7dfa25-9f4f-40c3-8b75-63a9dd939e91 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:55.251159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b7dfa25-9f4f-40c3-8b75-63a9dd939e91 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1221 microversion: 2.1 time: 0.369717 Aug 24 14:40:55.263780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 25/54] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:54 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1221 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:56.278602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0d48e084-5f57-496c-a6d7-9654396e1393 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:56.279295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0d48e084-5f57-496c-a6d7-9654396e1393 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:56.620575 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0d48e084-5f57-496c-a6d7-9654396e1393 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:56.633555 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0d48e084-5f57-496c-a6d7-9654396e1393 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1221 microversion: 2.1 time: 0.359509 Aug 24 14:40:56.636123 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 26/55] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:56 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1221 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:57.321187 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:57.321767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:57.322123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:57.322585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:57.323187 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:57.357991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.358502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.358984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.359756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.360202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.360615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.480026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Getting quotas for project 12399db473234188b469584eece6f33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:57.491978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Getting quotas for user 70aad00816f94d4096d5de2ae447c41b and project 12399db473234188b469584eece6f33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:57.512299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:57.516869 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:57.667717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:57.668610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:57.706130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.712088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.716157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.717618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.724029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.728706 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.745440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a57d7455-bee6-4d9e-8c14-bfe5fa433940 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.241026 Aug 24 14:40:57.754486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 30/56] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 6251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:40:57.775085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c713988b-fbdd-4297-9d0a-6504fce40e28 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:57.782822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c713988b-fbdd-4297-9d0a-6504fce40e28 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:58.215762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c713988b-fbdd-4297-9d0a-6504fce40e28 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:58.230726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c713988b-fbdd-4297-9d0a-6504fce40e28 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1214 microversion: 2.1 time: 0.467257 Aug 24 14:40:58.234846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 31/57] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:57 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1214 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:58.292216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1959356780", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee8165f2-1bc8-45c6-8269-1a2c05131ca9"}], "security_groups": [{"name": "tempest-securitygroup--1769589685"}], "key_name": "tempest-keypair-1519180671", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:58.492991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:58.529090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-111c6fe2-6e60-407f-85cb-37b07415bfc7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1273 microversion: 2.1 time: 0.870165 Aug 24 14:40:58.533073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 27/58] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:57 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1273 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:58.901228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] validate_networks() for [('ee8165f2-1bc8-45c6-8269-1a2c05131ca9', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:59.271998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:59.273422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:59.293361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.299229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.305030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.311906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.313218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.319035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.479184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:59.522605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b994274-3304-4ceb-a130-5d40d12287c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1218 microversion: 2.1 time: 0.253809 Aug 24 14:40:59.548330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 28/59] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:59 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:59.623333 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:59.639373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:59.664129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.665103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.677178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.678609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.681861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.683212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.127385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.148069 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d6f81925-0447-4896-8b6f-1c38e6f03ec7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1279 microversion: 2.1 time: 0.584230 Aug 24 14:41:00.152208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 29/60] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:59 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1279 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:00.575060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:00.576432 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:00.585666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:00.586206 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:00.586737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.587549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:00.588059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:00.588522 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.897024 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.906419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7025ada3-0eed-4807-9bc8-cb38675d63bc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1266 microversion: 2.1 time: 0.335609 Aug 24 14:41:00.907050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 30/61] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:00 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:01.178620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:01.179312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:01.198485 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.200599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.203308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.226589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.226589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.226589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.761364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:41:01.761909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:41:01.762235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:41:01.762728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:41:01.763143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:41:01.792161 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.793904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.795081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.796460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.797150 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.797934 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.825390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:01.832128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for user 1623364d853c42a88a7172adfa07ef89 and project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:01.846318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:41:01.849681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:41:01.919498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b6ff4d0-5313-48d5-86e7-1b9d49a7a7de tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.659965 Aug 24 14:41:01.920416 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 3682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:41:01.940442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:01.945682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:01.975316 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.978181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.985259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.988908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.991329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.994442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:02.399745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:02.417463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e7d36f9c-c7b1-4c49-bb1d-af4b4b788347 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 1.243453 Aug 24 14:41:02.420953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 31/63] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:01 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:02.431790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8407f809-93aa-4111-8d02-4bb436ac8e7c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:02.434599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8407f809-93aa-4111-8d02-4bb436ac8e7c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:02.500437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:02.545959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2162299e-6c0a-4d8d-9df4-3db9a8478e21 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1272 microversion: 2.1 time: 0.617212 Aug 24 14:41:02.570121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 33/64] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:01 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1272 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:02.574038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8407f809-93aa-4111-8d02-4bb436ac8e7c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:02.583567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8407f809-93aa-4111-8d02-4bb436ac8e7c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1238 microversion: 2.1 time: 0.160998 Aug 24 14:41:02.587525 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 32/65] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:02 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1238 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:03.447283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:03.452522 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:03.517204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.522921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.524248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:03.534574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.535728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.543246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:03.573112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:03.574779 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:03.598689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.599278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.599726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:03.610430 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.611188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.615550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:04.332527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.350264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-167549c0-0ffc-4586-b818-c77755d20a5e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.902817 Aug 24 14:41:04.363814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 34/66] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:03 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:04.383330 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:04.384269 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:04.406061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:04.407989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:04.409473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:04.411435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:04.413003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:04.414946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:04.459198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.468260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-92cd0744-52d8-44c1-a06c-4e63c7aa4e06 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1272 microversion: 2.1 time: 0.899231 Aug 24 14:41:04.484284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 33/67] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:03 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1272 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:04.575072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.584957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a0eb7092-3bda-4e28-a419-007748719f73 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1242 microversion: 2.1 time: 0.215745 Aug 24 14:41:04.606011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 35/68] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:04 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1242 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:05.378942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:05.380912 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:05.398886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:05.428531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.431605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.437031 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.443096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.447038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.448247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.494119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:05.495675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:05.516179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.520510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.524420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.525432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.530435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.531031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.730235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:05.767301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8fcf40bf-fcaa-46c0-867c-ac52c23e300f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1272 microversion: 2.1 time: 0.275520 Aug 24 14:41:05.812356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 36/69] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:05 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:05.849139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:05.852553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:05.886675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.888779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.890178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.909895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.910857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.913756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.116336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:06.136609 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e84c44b3-41c8-4c23-ab3f-e7f11e17a779 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1234 microversion: 2.1 time: 0.321604 Aug 24 14:41:06.137885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 37/70] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:05 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1234 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:06.230319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:06.252727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-91418f06-716a-4cc9-8d5e-ae29859dfdac tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.880839 Aug 24 14:41:06.257227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 34/71] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:05 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:06.723549 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f436c21c-2168-42dc-940a-75b7e9319477", "tag": "63ac2d0a-da4f-44c4-befa-11e028960fed"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:06.761952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:06.768555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:06.772086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.810151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:06.824053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:06.842297 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:06.849147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:06.849414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.850297 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:06.850863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:06.851347 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.865571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Creating event network-changed:63ac2d0a-da4f-44c4-befa-11e028960fed for instance f436c21c-2168-42dc-940a-75b7e9319477 on hv-cinder-84889 Aug 24 14:41:06.889429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:41:06.889940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-37d336e0-ba89-422a-b670-0a04c4334e57 req-3b2c70f1-72a5-46f4-8d0b-74ff4465d354 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:41:06.891761 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:06.892369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:06.903493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.907018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:06.910812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:06.911343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.964520 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.compute.rpcapi [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:41:06.970149 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] Releasing lock "compute-rpcapi-router" {{(pid=127296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:41:07.037856 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d6a847f8-3ee1-429b-ab2f-36e32ce337df None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.759037 Aug 24 14:41:07.040458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 38/72] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:07.173109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:07.177925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:07.193437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.194578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.200307 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:07.204247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.207490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.209901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:07.428318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:07.440094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4a457c17-46ac-4a12-8163-b89cb860eeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1290 microversion: 2.1 time: 0.281379 Aug 24 14:41:07.442301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 39/73] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:07 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1290 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:07.452954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:07.453865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:07.462377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.462998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.463578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:07.464535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.465040 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.465579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.041652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:08.054577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-690d9ae7-d5d4-47b0-aa0f-232e1a44c09c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.607947 Aug 24 14:41:08.067414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 40/74] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:07 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:08.224977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:08.239588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-200184ae-dfd7-4f2b-b007-357ee12dac22 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 1.439541 Aug 24 14:41:08.245252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 35/75] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:06 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:08.463468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:08.464158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:08.483003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.490836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.495235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.496135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.496623 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.497051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.808180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:08.849258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2ac4a4cb-74ed-4fef-aafc-df75f084e6d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1290 microversion: 2.1 time: 0.385867 Aug 24 14:41:08.864677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 41/76] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:08 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1290 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:09.085919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:09.086709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:09.116990 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.121001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.148576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.149912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.150541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.151026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.260605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618665e1-aacd-4ca7-873b-a47102ccfcb1", "tag": "f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:09.301826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.303625 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.304071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.381917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Creating event network-changed:f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac for instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 on hv-cinder-84889 Aug 24 14:41:09.382424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:41:09.382841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-97ba6dcd-f2b9-4577-803f-ee0175ac0e74 req-e350ebf7-cf3f-4be1-adcb-7cd09eeece89 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:41:09.384276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.384607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.385030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.385751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.386197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.396169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:09.404800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-01469e1b-3880-49e7-bcb4-3c273bd3c933 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.323427 Aug 24 14:41:09.405152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.407516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 42/77] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:09 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:09.423592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:09.425091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:09.452025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.compute.rpcapi [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:41:09.452991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] Releasing lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:41:09.463087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.463816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.466054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.466767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.467237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.470909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.519357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-39c949cb-9208-47d4-8144-09c6eb373881 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.841285 Aug 24 14:41:09.520300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 36/78] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:09.737309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:09.748857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2bdc8ca1-c304-4b2c-8aeb-497a4fbda51e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.338371 Aug 24 14:41:09.750678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 43/79] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:09 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:09.886834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:09.887556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:09.894766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.895554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.896609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:09.898060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:09.898890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:09.899834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.014179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.025582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c2e733e2-4ff2-4618-a264-403048ad22af tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1308 microversion: 2.1 time: 0.142976 Aug 24 14:41:10.028619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 37/80] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:09 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:10.436326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:10.436932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:10.444618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.445113 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.445546 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.446246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.447089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.447515 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.617391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.625248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-effc0a39-3238-4b72-a2ac-900802d53618 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.193711 Aug 24 14:41:10.625828 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 44/81] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:10 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:10.773990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:10.774633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:10.780866 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.781616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.782057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.782792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.783244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.783696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.939565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.947906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4ccc9162-6f8b-420b-8448-f8a6e4f0eb26 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.177951 Aug 24 14:41:10.948473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 38/82] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:10 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:11.049468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:11.050593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:11.060807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.060807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.060807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.060807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.061621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.061621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.171223 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:11.186155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d839ae2b-82e6-4fe8-af5f-bcf4e4b1051d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1308 microversion: 2.1 time: 0.141978 Aug 24 14:41:11.188104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 45/83] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:11 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:11.541908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe317be-d3bd-4cec-b354-918395c3d5e2", "tag": "356289de-b497-4de3-89f9-5551ea5eadaf"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:11.552129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.552695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.553131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.565801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] Creating event network-changed:356289de-b497-4de3-89f9-5551ea5eadaf for instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 on hv-cinder-84889 Aug 24 14:41:11.581632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-fd0ce498-c979-403c-a4bc-c359f71d9945 req-33b38395-6732-4144-95d2-6203e4de069f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033659 Aug 24 14:41:11.582606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 39/84] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:11.666442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:11.667276 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:11.685014 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.685556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.686033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.686817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.687305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.687713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.842735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=16 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:11.971433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:11.972642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:11.991367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.992215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.992851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.994618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.995835 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.996689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:12.313997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.335488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0441cf60-fe80-4249-a06c-591760b3aff4 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.369112 Aug 24 14:41:12.336340 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 40/85] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:11 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:12.349191 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:12.353684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:12.369617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.379397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cf355b62-efc5-42d3-acdd-9f2079e7f573 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.717234 Aug 24 14:41:12.393942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 46/86] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:11 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:12.395257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:12.395257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:12.395900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:12.396913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:12.397744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:12.398504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:12.582257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=22 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:12.632220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.667579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-abd8e16f-a1c0-4499-b543-f460db4f0c1f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1296 microversion: 2.1 time: 0.323350 Aug 24 14:41:12.673803 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 41/87] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:12 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:13.372738 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.374695 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:13.389836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.390656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.391348 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.393163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.393988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.394971 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.417625 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.418383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:13.433925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.436094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.437217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.439771 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.441473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.443422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.732293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:13.742768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c8740652-6d4e-4261-8b67-528de9f69b65 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.383625 Aug 24 14:41:13.743647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 47/88] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:13.761715 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.762747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:13.772498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.773216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.773567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:13.774103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.775071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.775728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.776343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.785191 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-28f26068-f622-4bb8-a9bc-980b39bb0d02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.383191 Aug 24 14:41:13.798193 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 42/89] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:13.885825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:13.895419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6a78d6dd-4a6e-4898-bc02-71782664807e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1296 microversion: 2.1 time: 0.145899 Aug 24 14:41:13.902999 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 48/90] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:14.763932 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:14.764565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:14.766767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:14.772317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.772814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.773207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.773966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.774316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.774752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.778795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=89 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:14.807031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:14.808646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:14.816937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.817672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.818336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.819194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.819880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.820439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.825015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:14.935052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.943040 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-88168c5b-b4b2-400a-b8e9-7c2631b483cf tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.182662 Aug 24 14:41:14.953216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 43/91] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:14 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:14.960158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:14.960817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:14.966845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.967333 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.967768 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.968469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:14.969764 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:14.970271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:14.988354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.997163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-60af6b58-bd07-420e-9d04-a7fc54ca4015 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.195324 Aug 24 14:41:14.997958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 49/92] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:14 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:15.047806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.056180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ecb620a4-2f4d-4176-81da-8bfef36dbe7f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1296 microversion: 2.1 time: 0.101415 Aug 24 14:41:15.056757 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 44/93] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:14 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:15.964635 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:15.965208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:15.967299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:15.972706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.973186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.973610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:15.974352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.974765 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.975175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.017695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.018292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:16.024997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.025492 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.025927 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.026683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.027129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.027556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.114944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.122817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6acf6f3a-a602-4083-81be-23bc6403eace tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.161953 Aug 24 14:41:16.123429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 50/94] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:15 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:16.128096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.128869 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:16.135116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.135799 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.136399 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.137287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.137706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.138133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.164909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.172791 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e43e76a3-0079-4757-bd2c-fef1af78f6f8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.159261 Aug 24 14:41:16.173377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 45/95] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:16 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:16.201401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.209928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1d42c079-91c2-485a-803e-9fd3831e8d79 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1296 microversion: 2.1 time: 0.085502 Aug 24 14:41:16.210534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 51/96] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:16 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:17.144905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.146179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:17.152463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.153271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.153913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.155148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.155838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.156692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.193374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.193980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:17.199982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:17.208127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.208593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.209037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.209739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.210190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.210635 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.377024 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.397384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fd3bdd9a-6ae8-46a3-886d-37cc8271bf03 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.251131 Aug 24 14:41:17.412985 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 46/97] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:17.420793 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.425140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:17.454059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.461776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.461776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.461776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.461776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.462468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.525506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.534901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-eb2f6afd-78ab-4efa-9c24-e9e12aa36549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.345300 Aug 24 14:41:17.543368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 52/98] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:17.626911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.635354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-faa00ab9-c12b-43f1-98b4-7cd051d34486 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.220969 Aug 24 14:41:17.636296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 47/99] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:18.417929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.419252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.426289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.426833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.427418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.428118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.428560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.428993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.556915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.557498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.566921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.567470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.567920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.568677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.569154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.569562 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.591405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:18.599694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4e56bb4b-a442-4006-bbb8-d2ca225df20c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.186054 Aug 24 14:41:18.600616 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 53/100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:18.658260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.658923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.667282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.668484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.669107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.669816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.670991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.671418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.725172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:18.736354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4ff4b96e-9afe-4728-99ce-ecd494794766 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.184310 Aug 24 14:41:18.736950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 48/101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:18.840162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:18.851621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-991c107d-ce53-4e22-a040-6ad30ee07888 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.198063 Aug 24 14:41:18.854038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 54/102] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:19.630683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.633073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.643583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:19.648177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.649624 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.650971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.652606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.653756 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.654960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.758293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.760460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.768587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.769490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.770128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.771393 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.772074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.772987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.977431 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:19.988894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b5ef02f0-d6b1-47d8-84bb-79d1c17c7cf8 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.370339 Aug 24 14:41:19.989515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 49/103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:20.002285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:20.006824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:20.015861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.016923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.017532 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.018770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.019470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.020512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.090051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.099294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cdb1e298-0c2c-4556-9a6a-6b308a873549 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.346112 Aug 24 14:41:20.101555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 55/104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:20.297545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.312916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-55dbba64-429a-45b2-aab4-b6c8eb0afbd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.318998 Aug 24 14:41:20.313840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 50/105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:20.554454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb600b0-9df3-4758-9663-8b67de110251", "tag": "5fa591d5-5e29-4df7-9d1d-592f00c2f14c"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:20.565142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.566224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.566689 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.580552 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] Creating event network-changed:5fa591d5-5e29-4df7-9d1d-592f00c2f14c for instance 9bb600b0-9df3-4758-9663-8b67de110251 on hv-cinder-84889 Aug 24 14:41:20.586381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-1e73b042-1226-48f1-8a4e-a28b1bfc649e req-52be09f9-f22b-4a7b-91d5-48a35cd5be6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Aug 24 14:41:20.587718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 56/106] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:21.013195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.014600 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.022148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.023873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.024762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.026110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.026814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.030144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.125423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.126127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.137329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.138825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.145929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.147312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.147950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.148530 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.455970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.471766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e47e7262-8621-4065-8956-9c244875e318 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.462337 Aug 24 14:41:21.474122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 51/107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:21.480684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.495824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.510710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.511252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.511689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.512911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.513561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.514134 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.810817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.826961 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c3d9212c-3695-48b4-a474-f7aed907476e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.348145 Aug 24 14:41:21.826961 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 52/108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:21.988581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.014688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-52814e28-bb8c-45b5-b3b1-8a341ee3db23 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.893560 Aug 24 14:41:22.015780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 57/109] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:22.504465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:22.505488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:22.514956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.515709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.516358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.517733 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.518425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.519114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.750821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.759921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-73a00166-a278-44e2-8353-3dbc4dfdfa54 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.270016 Aug 24 14:41:22.767799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 53/110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:22 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:22.846930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:22.848062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:22.864250 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.865126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.865903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.866388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.867049 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.867483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.025510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:23.033903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-30de6f2c-7286-41ab-970d-a767e29aedba tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.193012 Aug 24 14:41:23.036359 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 58/111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:22 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:23.049823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:23.052155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:23.062075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.062682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.063083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.063822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.064472 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.065205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.215200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:23.223642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da213186-e9f5-4c11-baf8-5f70396d9544 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.182652 Aug 24 14:41:23.224319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 54/112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:23 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:23.780883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:23.781493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:23.788197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.788606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.789039 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.789736 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.790190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.790644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.934016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:23.942484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-30f46736-f42d-4835-a139-1c71df869b48 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.165452 Aug 24 14:41:23.943114 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 59/113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:23 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:24.055960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:24.056583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:24.063524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.064020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.064463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.065179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.065634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.066063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.208779 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.216937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-37202aef-a09d-47e4-b2f1-d46e5ed523d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.165012 Aug 24 14:41:24.217512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 55/114] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:24 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:24.245405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:24.246614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:24.252962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.253723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.254235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.255039 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.255557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.256051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.401753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.410608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-21e10c59-aab4-403e-806b-a8fad37aa2b9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.168947 Aug 24 14:41:24.411672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 60/115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:24 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:24.964948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:24.965585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:24.972808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.973398 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.973848 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.974584 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.975044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.975462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.125530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.134553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-653984b0-c1f1-450c-8fca-a9326741d85d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.173815 Aug 24 14:41:25.135154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 56/116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:24 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:25.237393 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:25.238037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:25.244409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.244912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.245349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.246071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.246544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.246988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.394915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.404109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4851fd03-54ba-41ed-92a2-031ed95390e3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.170675 Aug 24 14:41:25.404726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 61/117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:25 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:25.431176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:25.431785 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:25.438251 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.438757 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.439186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.439876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.440319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.440730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.584129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.594448 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-271f5cd0-9382-45c3-aa3e-36ce6f6fb3c4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.166703 Aug 24 14:41:25.595577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 57/118] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:25 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:26.156224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.156849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.165796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.166289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.166756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.167480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.167941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.168360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.328258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.337447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8b8ef649-b819-44d4-b813-4dcfdd805e77 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.185076 Aug 24 14:41:26.338804 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 62/119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:26.428967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.430285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.442453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.443223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.443968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.445155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.445849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.446494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.623987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.625432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.638669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.639470 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.640416 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.641375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.643030 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.643810 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.985507 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:27.009652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-513877ca-bfbd-4e27-abfb-7ca238ebb7f4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.586228 Aug 24 14:41:27.013038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 58/120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:27.105342 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:27.119950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-41db2843-a995-47b8-909c-5c38d0804e8e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.506042 Aug 24 14:41:27.136025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 63/121] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:27.375642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:27.379870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:27.397598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.399557 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.401392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.402874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.403916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.404762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.625406 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:27.633425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:27.645576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f80d8439-98d0-4eb4-9056-434f561b031e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.283841 Aug 24 14:41:27.646565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 59/122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:27 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:28.035510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:28.036313 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:28.048705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.049492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.050097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.051019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.051736 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.052354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.152093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:28.153059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:28.160717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.161603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.162218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.163104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.164721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.165367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.299868 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.349239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-70211f4c-1deb-4c0a-b921-86401f5bd480 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.318271 Aug 24 14:41:28.349991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 64/123] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:28 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:28.488196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.516001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-97628045-a523-4244-91ee-10644257738f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.368128 Aug 24 14:41:28.517498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 60/124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:28 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:28.688566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:28.689979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:28.709304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.710637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.715846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.717086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.717838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.720813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.293997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.318858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-012e3425-5b56-440b-a06f-23331e96f481 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.626294 Aug 24 14:41:29.319515 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 65/125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:28 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:29.390236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.391925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:29.407507 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.408950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.410275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.411567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.412234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.413261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.628885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.657144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ae7874ee-db86-47dc-9a4d-a45b5177f79b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.273820 Aug 24 14:41:29.669553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 61/126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:29.677215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.677834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:29.685184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.685682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.686280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.687913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.688573 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.688903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.724289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618665e1-aacd-4ca7-873b-a47102ccfcb1", "name": "network-vif-plugged", "status": "completed", "tag": "f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:29.741867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.742343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.756947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.805208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] Creating event network-vif-plugged:f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac for instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 on hv-cinder-84889 Aug 24 14:41:29.822573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-70e15c54-58d9-4cea-9905-902a1e06ab4f req-42b96c15-135c-4bac-9a7e-0d33f7dc892d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322925 Aug 24 14:41:29.829604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 66/127] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:30.081376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.091731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0ce831a4-d300-4679-bddc-5f01e341fd7d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.420998 Aug 24 14:41:30.105858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 62/128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:30.340862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:30.341574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.349773 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.350649 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.352435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.353608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.354257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.355106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.359987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:30.642315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.652976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ab0c8e3d-c2a5-4f9b-9eff-f6346ba9713d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.316131 Aug 24 14:41:30.654495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 67/129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:30 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:30.686698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:30.687319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.694363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.694874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.695298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.695985 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.696470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.696881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.885579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.899632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-12828301-52a7-483c-a8c9-ae2da488efd5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.217854 Aug 24 14:41:30.900545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 63/130] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:30 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:31.111659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.112709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.119665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.132697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.133311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.134430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.135254 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.135873 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.426915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:31.439049 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2142e1a1-e2ba-4e98-a7ae-ce57d2a00f84 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.331411 Aug 24 14:41:31.440506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 68/131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:31.678750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.679935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.686676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.687494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.688578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.689581 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.690251 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.690908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.853113 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:31.863840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-015c389f-ff0a-4d07-9c3e-203da0103c2d tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.190901 Aug 24 14:41:31.865238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 64/132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:31.883228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f436c21c-2168-42dc-940a-75b7e9319477", "name": "network-vif-plugged", "status": "completed", "tag": "63ac2d0a-da4f-44c4-befa-11e028960fed"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:31.899370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.900467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.901060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.921952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.922889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.931766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] Creating event network-vif-plugged:63ac2d0a-da4f-44c4-befa-11e028960fed for instance f436c21c-2168-42dc-940a-75b7e9319477 on hv-cinder-84889 Aug 24 14:41:31.934200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.936388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.938836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.939761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.942446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.943214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.945058 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-132b3afe-d0f7-453b-b324-fd321c205ef0 req-97606037-8e58-43d2-9ebc-ef8f3e873026 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065594 Aug 24 14:41:31.949800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 69/133] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:32.460986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.461660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.472765 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.473506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.473942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.474708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.475162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.475880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.527149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.539372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-70a1ea0c-913b-404b-b990-9d978ad16da3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.622061 Aug 24 14:41:32.542811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 65/134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:32.705180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.717868 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e66b12fd-45ca-4773-9a63-2408e7795755 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.261216 Aug 24 14:41:32.719546 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 70/135] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:32.913940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.916881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.956116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.956992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.957863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.959097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.960266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.961227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.434829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.453864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f75ca955-b649-405c-817b-5ef4039563d7 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.563077 Aug 24 14:41:33.455863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 66/136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:33.575527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:33.576532 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:33.604593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.605660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.606989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.612219 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.613111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.613864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.748690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:33.762143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:33.791773 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.795088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.798444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.801271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.804026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.807021 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.959862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.975798 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-32879197-c8f2-422c-881c-d2121fb312db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.413808 Aug 24 14:41:33.989604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 71/137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:33 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:34.110064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.120257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e3676a2-1281-41f4-a44b-08fdc788f6f0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.381134 Aug 24 14:41:34.121186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 67/138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:33 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:34.482829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:34.484351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:34.496490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.497860 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.498834 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.500162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.500898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.501723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.753458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.785357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9f462c29-2527-499c-98b9-3285c2903cd3 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.304035 Aug 24 14:41:34.798770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 72/139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:34 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:35.001717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.003327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.012759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.013968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.014616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.016828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.018108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.019091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.174945 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.176050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.198314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.204231 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.205017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.208995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.209794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.210554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.361391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:35.373179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a9cfd8b-1f2b-42fb-824e-db19e929c562 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.377902 Aug 24 14:41:35.387181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 68/140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:34 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:35.425927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:35.442044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3bcdf5b6-8b24-45c0-81c5-3eb808e84351 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.272969 Aug 24 14:41:35.443284 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 73/141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:35 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:35.809316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.809983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.822192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.829458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.830210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.830991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.831462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.832248 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.028949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.038316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b4e56ff5-a6dd-4472-8ebd-d29148ed4df5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.232842 Aug 24 14:41:36.039391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 69/142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:35 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:36.399763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.401464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.414707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.416254 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.417634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.421197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.423449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.424870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.464438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.465061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.475987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.477890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.478538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.480728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.482115 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.485441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.658940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.682163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-de42c685-33b8-41c7-ba78-950064df9a14 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.220811 Aug 24 14:41:36.685639 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 70/143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:36.817845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.839307 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3f82b02b-d7de-4534-bafc-8365a89a3ae8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.440615 Aug 24 14:41:36.844162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 74/144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:37.065683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.068983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.095220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.096975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.101179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.106548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.107613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.111481 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.415646 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:37.424922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f6070348-6e69-4b09-9d26-ce3052b93e56 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.368011 Aug 24 14:41:37.433429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 71/145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:37.709084 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.709702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.715851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.716338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.716769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.717634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.718249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.718856 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.888470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.888470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.927325 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.927841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.928285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.928986 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.929425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.929842 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.007391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.022222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-21fe19ef-9398-4c91-a819-72a200216d4d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.317423 Aug 24 14:41:38.023483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 75/146] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:38.244736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.265666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bbf44752-a0f7-4a17-8683-e3fb38a6cd65 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.391377 Aug 24 14:41:38.267894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 72/147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:38.449954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:38.450766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:38.470053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:38.470599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:38.471042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.474951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:38.475583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:38.476080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.677074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.685883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dcb0fbe2-d577-4134-ad0d-30932d65d6c9 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.242725 Aug 24 14:41:38.686583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 76/148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:38 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:39.043876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.044758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.055023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.055992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.056801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.058345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.059282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.060003 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.273175 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.290282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8bf4da65-5543-40af-921d-e3284069a30b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.250298 Aug 24 14:41:39.291542 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 73/149] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:39.318674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.322220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.329085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.329621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.330067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.330821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.331415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.332318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.537476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.549251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-12bf5194-1d47-4226-a516-43d79719c29f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.235688 Aug 24 14:41:39.550487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 77/150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:39.599463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb600b0-9df3-4758-9663-8b67de110251", "name": "network-vif-plugged", "status": "completed", "tag": "5fa591d5-5e29-4df7-9d1d-592f00c2f14c"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:39.626255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.626255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.626586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.640965 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] Creating event network-vif-plugged:5fa591d5-5e29-4df7-9d1d-592f00c2f14c for instance 9bb600b0-9df3-4758-9663-8b67de110251 on hv-cinder-84889 Aug 24 14:41:39.647852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-12c27bb5-4ee8-4625-b7b5-029670366af8 req-cdb9d5ad-78e8-4ca7-8403-08e944703898 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056440 Aug 24 14:41:39.648447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 74/151] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:39.712619 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.713744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.726397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.728118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.729496 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.731701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.733469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.735929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.093152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.104692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6b202a99-5f38-4cdf-a7d7-d9345462a92c tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.396535 Aug 24 14:41:40.119277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 78/152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:40.338015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.339326 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.346189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.346896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.347546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.348760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.349373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.349799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.552220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.571228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.571844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.574945 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-df292f69-a2f3-4553-a76f-020d9e6fd29d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1321 microversion: 2.1 time: 0.232097 Aug 24 14:41:40.577101 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 75/153] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:40.579938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.582409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.583229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.584108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.584563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.585121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.951716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.968153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-607f4846-59d0-40c8-aa1e-2a0d03d20ee8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.398194 Aug 24 14:41:40.970658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 79/154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.132569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.133449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.147232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.148426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.148870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.150503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.150503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.150988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.420869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.430287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-967795d1-77e3-4f1d-895c-0c5db282cadd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.302107 Aug 24 14:41:41.431138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 76/155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.597529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.598486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.607733 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.608571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.609294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.610428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.611235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.611949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.785008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe317be-d3bd-4cec-b354-918395c3d5e2", "name": "network-vif-plugged", "status": "completed", "tag": "356289de-b497-4de3-89f9-5551ea5eadaf"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:41.803380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.804270 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.804892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.822995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:41.825678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] Creating event network-vif-plugged:356289de-b497-4de3-89f9-5551ea5eadaf for instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 on hv-cinder-84889 Aug 24 14:41:41.832635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-c4616d23-3778-454c-9835-554c28633dc2 req-49d29590-79c6-4ed7-b6a3-d758e8391cfa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060673 Aug 24 14:41:41.836107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 77/156] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:41.843293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.852449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c78ffcde-cc0a-4f0b-a9b6-566da8e8b710 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1515 microversion: 2.1 time: 0.258932 Aug 24 14:41:41.853382 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 80/157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.877701 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:41.880591 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.887860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.888615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.889180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.889991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.890604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.891131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.990178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.990820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.006725 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.007717 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.009986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.010888 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.012787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.014194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.023698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'flavor' on Instance uuid f436c21c-2168-42dc-940a-75b7e9319477 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:42.362488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3488a3d6-8381-4509-abeb-31b18d6f3e62 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477/action" status: 200 len: 32 microversion: 2.1 time: 0.489624 Aug 24 14:41:42.363156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 78/158] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:41:41 2022] POST /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:41:42.377515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.378220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.395535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.396082 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.396723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.397500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.397919 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.398349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.493471 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.506418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2ec115f8-018a-455a-8a17-8c9b9a7b0c35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1364 microversion: 2.1 time: 0.520702 Aug 24 14:41:42.522583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 81/159] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1364 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:42.544632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.545273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.571706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.572202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.573319 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.574226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.585906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.585906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.722129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.756009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6588234b-8bff-402a-9960-097df7071487 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.383354 Aug 24 14:41:42.757752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 79/160] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:42.931021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.943119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2014649d-32a6-4850-a556-95149f01a642 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.408217 Aug 24 14:41:42.946690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 82/161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:43.547180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.548568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.561418 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.562896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.564686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.566190 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.567413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.568440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.768703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.793782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.794961 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.797145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-997e8142-eccc-41d5-b884-90d15fdc8176 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1551 microversion: 2.1 time: 0.257927 Aug 24 14:41:43.803554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 80/162] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1551 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:43.815331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.815331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.816966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.818744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.819676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.820491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.838865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.839737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.853878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.860491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.862457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.864845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.867705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.868199 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.119587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.132841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4702cb20-dc34-421f-beb0-27f47fdfe634 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.348029 Aug 24 14:41:44.134063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 83/163] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:44.140563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:44.141731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.151019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.152675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.153296 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.155561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.156239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.157314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.209550 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:44.289127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-acc5273f-9aa8-4d95-b825-db2b5c37b3bf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.454593 Aug 24 14:41:44.289743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 81/164] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-interface => generated 285 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:44.734063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.776748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1d3582cf-d202-4990-a5c4-eb9dca0f7afe tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.639573 Aug 24 14:41:44.779163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 84/165] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:44 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:45.171856 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.172688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.174501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=78 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:45.185071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.189640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.191103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.193125 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.195461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.196996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.774944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:45.790959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-00cbf358-29d6-4b28-8935-b9c008422ff3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.622581 Aug 24 14:41:45.792599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 82/166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:45.811203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.812978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.821401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.822181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.822830 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.823712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.824406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.825047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.235523 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:46.245597 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a0b7daf8-1be8-4dd5-826e-d64e568703cd tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1314 microversion: 2.1 time: 0.438610 Aug 24 14:41:46.249774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 85/167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:46.819141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:46.823442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:46.852084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.853138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.854068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.855404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.859646 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.860674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.275198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:47.276225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:47.296439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=72 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:47.327782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.334983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.338459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.348516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.352069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.355564 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.376290 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:47.450905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d19cebe-f6b6-481f-b16f-61be6102c7dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.636596 Aug 24 14:41:47.457773 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 83/168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:46 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:47.509132 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb600b0-9df3-4758-9663-8b67de110251", "tag": "5fa591d5-5e29-4df7-9d1d-592f00c2f14c"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:47.559852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.561360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.563329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.632495 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] Creating event network-changed:5fa591d5-5e29-4df7-9d1d-592f00c2f14c for instance 9bb600b0-9df3-4758-9663-8b67de110251 on hv-cinder-84889 Aug 24 14:41:47.654415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9a42cd3c-8b23-45cf-a295-c3c1c2353ef1 req-e9e77b12-3142-483b-bd35-1d0218d3abdf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188442 Aug 24 14:41:47.656988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 84/169] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:48.152846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:48.173325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7988d3f2-3ab4-4915-b02c-0f649d0570fa tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1502 microversion: 2.1 time: 0.906472 Aug 24 14:41:48.181050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 86/170] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:47 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1502 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:48.502453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:48.506686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.537202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.545568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.545568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.551263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.552584 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.556075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.317905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.342042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bc0f589d-ab0b-4dfe-a1b4-6e06477e6f4a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.851739 Aug 24 14:41:49.349563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 85/171] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:48 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:50.390580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.396782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.407005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.407776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.414055 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.415106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.415570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.415991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.514127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70be094c-1c3e-41a0-84d6-5e952e0a2577"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:50.517068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.525525 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.526647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.527344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.528840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.529743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.530664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.844461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.852900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1227fb2e-acbc-4f07-9be0-70d56be63172 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.472355 Aug 24 14:41:50.860081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 87/172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:51.500554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-74908d8d-9457-4433-b73a-e6eb3c2ad53b tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "POST /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986813 Aug 24 14:41:51.506601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 86/173] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:41:50 2022] POST /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:51.885943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.886672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.899962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.900609 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.903726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.905142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.905886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.906589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.125680 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.140062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d3780521-f5cf-4501-b1f8-508649904e02 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.258437 Aug 24 14:41:52.155887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 88/174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:51 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:53.164802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:53.166372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:53.179285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.180173 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.180966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.182442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.183479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.185148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.550093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:53.563068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-04194367-4597-4fff-a5ef-149cf83c06dc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.404833 Aug 24 14:41:53.581976 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 87/175] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:53 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:54.603520 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.605607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.632337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.633492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.635197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.637913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.640512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.641774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.964981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.986317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-55e74b77-7bac-4d77-bd59-cf25ee6f6e03 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.390009 Aug 24 14:41:54.999856 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 89/176] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:56.026677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.028335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.036512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.037853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.038798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.040539 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.041303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.042167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.318401 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:56.337915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d0ca1db-5cd9-4650-85ba-a7957b6943f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.314897 Aug 24 14:41:56.339682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 88/177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:57.384409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:57.385866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:57.398269 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.399078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.399719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.400612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.401229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.401809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.582463 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.594547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-05aaa489-663c-4443-92f7-ca97ca323035 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.217939 Aug 24 14:41:57.597753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 90/178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:57 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:58.634502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:58.635807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:58.647427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.648238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.649042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.650315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.651110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.651790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.955166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:58.970303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7d7f63ad-2068-4547-9e19-727996f53741 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.345312 Aug 24 14:41:58.971155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 89/179] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:58 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:00.002458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:00.005445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:00.026279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.027610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.029548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.031027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.031709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.032602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.376857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:00.398136 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fc201e3d-8b58-4215-9bb3-3756882d6786 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.408832 Aug 24 14:42:00.399651 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 91/180] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:59 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:01.435026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:01.435670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:01.459224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.459224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.459224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.459224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.460092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.460092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.746191 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.757900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-157e1e60-4ad5-4585-9c74-7d0ef27dbc93 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.326719 Aug 24 14:42:01.758739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 90/181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:01 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:02.113472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.114364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.120645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.121408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.121998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.122969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.123575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.124143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.164173 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:42:02.399979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6af44c72-39e3-43d8-815c-301e447033d5 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 204 len: 0 microversion: 2.1 time: 0.290834 Aug 24 14:42:02.400908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 92/182] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:02 2022] DELETE /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:42:02.413005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.414095 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.425087 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.425881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.426830 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.428423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.429321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.430109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.711824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.723199 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e5375caa-0c28-4b09-ab16-aa5e345c098e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1554 microversion: 2.1 time: 0.315578 Aug 24 14:42:02.726929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 91/183] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1554 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:02.787668 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.789020 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.812685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.813702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.815737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.817216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.818276 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.819763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.158500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.184851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dd540bdb-552e-4600-9ffb-fd0411c3ead7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.407963 Aug 24 14:42:03.187502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 93/184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:03.775414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.778734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:03.795295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.796547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.797676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.799026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.800810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.801468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.810795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:04.038491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.053412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-62e41c60-3a46-4110-b4be-091d1a3419e2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1554 microversion: 2.1 time: 0.288993 Aug 24 14:42:04.054439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 92/185] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:03 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1554 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:04.226543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:04.229395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:04.237781 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.238893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.239785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.241177 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.241890 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.242705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.467829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.484101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-67675a30-32a5-40c6-a226-f279a9979a9c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.266598 Aug 24 14:42:04.497879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 94/186] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:04 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:05.092182 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:05.094362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.120433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.121217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.121929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.123431 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.124368 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.127530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.429969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.446381 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-10829ee5-a8ef-4c91-81fd-bf01a38e53cc tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1554 microversion: 2.1 time: 0.361167 Aug 24 14:42:05.447654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 93/187] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1554 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:05.508737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:05.509570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.528082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.528707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.529354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.530052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.530489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.531111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.799690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.814476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3f8eb66f-127b-4584-9df3-f5782d47cc51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.311315 Aug 24 14:42:05.816703 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 95/188] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:06.476219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.476990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.503392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.506052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.507864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.510035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.510786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.513102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.850547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.851335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.860741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.861569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.862302 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.863794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.864732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.865449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.866761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.879958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1cc0426e-9631-4a64-a223-2c4b198572a0 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1554 microversion: 2.1 time: 0.411742 Aug 24 14:42:06.882538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 94/189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1554 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:07.285511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:07.321172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4d12d50c-526e-4042-9bd0-1e6db91bf6da tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.475947 Aug 24 14:42:07.322094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 96/190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:07.332955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe317be-d3bd-4cec-b354-918395c3d5e2", "name": "network-vif-deleted", "tag": "356289de-b497-4de3-89f9-5551ea5eadaf"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:07.360438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.361007 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.361468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.409436 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] Creating event network-vif-deleted:356289de-b497-4de3-89f9-5551ea5eadaf for instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 on hv-cinder-84889 Aug 24 14:42:07.436928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-10ee5fb7-2fd6-4855-b4fd-d41fc748a91b req-69ad40e5-8f86-46e4-88ac-5d86eb2456d9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115661 Aug 24 14:42:07.447286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 95/191] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:07.906412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:07.907495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:07.918465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.918981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.919400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.920094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.920534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.920948 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.992569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aad00816f94d4096d5de2ae447c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12399db473234188b469584eece6f33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.001848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b333289e-8293-4623-8c04-84c1aec02653 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 200 len: 1345 microversion: 2.1 time: 0.100325 Aug 24 14:42:08.002431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 97/192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:07 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:08.371611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.372528 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.383926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.384450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.385309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.386709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.387829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.388510 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.607423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.622097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bff03c46-aae2-41ed-9e75-a5f0a8d9f8d1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.259002 Aug 24 14:42:08.622820 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 96/193] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:09.024257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.025746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:09.034313 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.034839 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.035255 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.035979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.036456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.037176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.051558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] HTTP exception thrown: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Request method failure captured: Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 HTTP/1.1 Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhy0AvAiQSGuNbiDRSJh8rLOjbxTrrxsdAOhDTxmKbT4SD8IcQScqOwwBN_KBKbo1WffOXEAAalzCaPt4jq_QlmmRUC7DAwmtm2KT5QisFoZGq2ZWmaOSG2WeNoXpCDKf-YRbACt3NhAcIIOTRHh30wEhjXR-JxAj8FWf9BZe28YlM Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:42:09.056197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_12399db473234188b469584eece6f33a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/12399db473234188b469584eece6f33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 70aad00816f94d4096d5de2ae447c41b Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.058741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '6fe317be-d3bd-4cec-b354-918395c3d5e2'} Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:09.060345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.063085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.065021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Returning 404 to user: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:09.065021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a2d6724d-a857-49bb-b98a-9757406fe9d2 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 404 len: 111 microversion: 2.1 time: 0.038160 Aug 24 14:42:09.065021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 98/194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:09.207960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.212015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:09.219257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.219744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.220171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.220950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.221395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.221814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.239885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] HTTP exception thrown: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Request method failure captured: Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2/os-volume_attachments HTTP/1.1 Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhy0AvAiQSGuNbiDRSJh8rLOjbxTrrxsdAOhDTxmKbT4SD8IcQScqOwwBN_KBKbo1WffOXEAAalzCaPt4jq_QlmmRUC7DAwmtm2KT5QisFoZGq2ZWmaOSG2WeNoXpCDKf-YRbACt3NhAcIIOTRHh30wEhjXR-JxAj8FWf9BZe28YlM Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:42:09.244187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_12399db473234188b469584eece6f33a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/12399db473234188b469584eece6f33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 70aad00816f94d4096d5de2ae447c41b Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.246692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'server_id': '6fe317be-d3bd-4cec-b354-918395c3d5e2'} Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:09.247957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:09.250489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:09.255737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Returning 404 to user: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:09.255737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-31803e09-3354-4530-983e-14b4be9e211e tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044705 Aug 24 14:42:09.255737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 97/195] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:09.651376 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.660881 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:09.673778 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.674663 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.675389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.676584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.677417 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.678099 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.903906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.931794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-429afbbd-85b8-49cd-bd89-073eb6994fe4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.275030 Aug 24 14:42:09.931794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 99/196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:10.515059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.519480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.527967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.528834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.529847 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.531175 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.531958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.532716 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.564035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] HTTP exception thrown: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Request method failure captured: Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 HTTP/1.1 Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhy0AvAiQSGuNbiDRSJh8rLOjbxTrrxsdAOhDTxmKbT4SD8IcQScqOwwBN_KBKbo1WffOXEAAalzCaPt4jq_QlmmRUC7DAwmtm2KT5QisFoZGq2ZWmaOSG2WeNoXpCDKf-YRbACt3NhAcIIOTRHh30wEhjXR-JxAj8FWf9BZe28YlM Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:42:10.568180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_12399db473234188b469584eece6f33a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/12399db473234188b469584eece6f33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 70aad00816f94d4096d5de2ae447c41b Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.570722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '6fe317be-d3bd-4cec-b354-918395c3d5e2'} Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:10.572030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.574164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.579926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Returning 404 to user: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:10.579926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2b1d679a-9fb4-44ff-95e8-b59c637fd77f tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 404 len: 111 microversion: 2.1 time: 0.067377 Aug 24 14:42:10.581610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 98/197] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:10 2022] DELETE /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:10.601982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.602615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] [instance: 6fe317be-d3bd-4cec-b354-918395c3d5e2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.611768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.612568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.613164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.614158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.614900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.615591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.623257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:10.656006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] HTTP exception thrown: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Request method failure captured: Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 HTTP/1.1 Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhy0AvAiQSGuNbiDRSJh8rLOjbxTrrxsdAOhDTxmKbT4SD8IcQScqOwwBN_KBKbo1WffOXEAAalzCaPt4jq_QlmmRUC7DAwmtm2KT5QisFoZGq2ZWmaOSG2WeNoXpCDKf-YRbACt3NhAcIIOTRHh30wEhjXR-JxAj8FWf9BZe28YlM Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:42:10.658570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_12399db473234188b469584eece6f33a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12399db473234188b469584eece6f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/12399db473234188b469584eece6f33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 12399db473234188b469584eece6f33a Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800417966 Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 70aad00816f94d4096d5de2ae447c41b Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-DeleteServersTestJSON-1800417966-project Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.659817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '6fe317be-d3bd-4cec-b354-918395c3d5e2'} Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:10.660861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. Aug 24 14:42:10.662423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:42:10.663917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] Returning 404 to user: Instance 6fe317be-d3bd-4cec-b354-918395c3d5e2 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:10.663917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-90a653a6-018e-478c-8104-da6f83037951 tempest-DeleteServersTestJSON-1800417966 tempest-DeleteServersTestJSON-1800417966-project] 10.222.0.90 "GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2" status: 404 len: 111 microversion: 2.1 time: 0.063221 Aug 24 14:42:10.663917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 100/198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/servers/6fe317be-d3bd-4cec-b354-918395c3d5e2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:10.952025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.952619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.966015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.966968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.967498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.968335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.974647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.975784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:11.281309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.347292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bcccb1d8-dad7-43d1-ae28-19880d4817f1 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.398242 Aug 24 14:42:11.350696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 99/199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:12.392132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.394890 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:12.415060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.418765 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.419567 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:12.421660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.422733 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.423632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.086226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.105279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b7224a6-16cc-4ae5-bc6f-6b8bc1c0b7ae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.720915 Aug 24 14:42:13.107451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 101/200] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:12 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:14.141179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.143637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:14.160487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.161220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.161844 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.162850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.164151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.166736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.685760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.696247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e207063b-1f52-44c6-a0ef-d87f8e1e5ee8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.571741 Aug 24 14:42:14.703207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 100/201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:15.718824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.719576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:15.735435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.754606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.759446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.760854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.761703 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.763309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:16.223170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:16.235016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8b9a484a-f848-4231-8fa2-3b15d358a643 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.518557 Aug 24 14:42:16.236088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 102/202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:17.265729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:17.267038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:17.269363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=38 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:17.282705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.283196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.283631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.284343 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.285063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.285657 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.578721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.592595 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0c3f1820-d97b-4522-885d-13f8460f88f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.334368 Aug 24 14:42:17.599648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 101/203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:17 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:18.613658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:18.614280 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:18.616356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:18.655273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.656205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.656784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.657518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.657982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.658424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.878614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.907553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-31576a9e-86d6-4789-9757-8be0a4efca48 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.297696 Aug 24 14:42:18.908925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 103/204] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:18 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:19.933322 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:19.935291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:19.945631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.946602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.947448 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.948222 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.948871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.949449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.201188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.206109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad072a7a-5dfd-4e63-960e-7a020690416b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.279628 Aug 24 14:42:20.208308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 102/205] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:19 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:21.258089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:21.258089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:21.261776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:21.262019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:21.262457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:21.263713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:21.264504 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:21.265227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:21.559337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:21.575551 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1ee96bc1-4654-4d93-b2fe-f97635049e97 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.347746 Aug 24 14:42:21.576915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 104/206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:21 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:22.599609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:22.600602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:22.610944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.612142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.612879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.613910 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.614703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.615424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.833162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:22.849667 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d5db043-b68a-4dba-b94f-36a848f4c016 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.255287 Aug 24 14:42:22.851030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 103/207] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:22 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:23.874751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:23.876876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:23.883793 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.884473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.885146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.886069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.886939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.887434 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.087222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:24.096791 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e62fc2ab-83e9-4234-9c31-2ca77b2ada22 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.227677 Aug 24 14:42:24.097496 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 105/208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:23 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:25.117832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:25.119207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:25.126083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:25.126749 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:25.127282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.128167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:25.128748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:25.129642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.353498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.382334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-34e6bd3d-ba09-4939-af98-f35cc8fcf34b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.263421 Aug 24 14:42:25.403835 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 104/209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:25 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:26.413537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:26.414683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:26.421917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.422409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.422962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.423573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.424028 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.424442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.619019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.630927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d512527f-9734-4fac-8c6f-90ebedad11aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.221777 Aug 24 14:42:26.632385 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 106/210] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:26 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:27.355394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1003928936", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "networks": [{"uuid": "227b76b1-0b7e-4dde-a5cc-fdbc91c5edcc"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:27.429833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] validate_networks() for [('227b76b1-0b7e-4dde-a5cc-fdbc91c5edcc', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:42:27.655101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:27.656711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:27.665153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.666244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.667300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.668890 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.670000 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.670899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.995176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.014713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4a03be66-4e07-4b72-bfb4-445d08fb6b6d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1521 microversion: 2.1 time: 0.363596 Aug 24 14:42:28.017701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 107/211] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:27 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:28.019442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:42:28.019976 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:42:28.020789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:42:28.021489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:42:28.022249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:42:28.036142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:28.037054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:28.037654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:28.039103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:28.040171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:28.040864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:28.070621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Getting quotas for project 21471957737c4c42949ad067de224cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:42:28.078178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Getting quotas for user dc387b373c2544b3b39feb0cddfbb585 and project 21471957737c4c42949ad067de224cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:42:28.091614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:42:28.094043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:42:28.160261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bbb17a56-75c7-4800-bacf-b786d8e1c4bb tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812958 Aug 24 14:42:28.171267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 105/212] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:42:28.183418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3d3225af-29ca-4884-be28-9448af26f2c8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:28.184622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3d3225af-29ca-4884-be28-9448af26f2c8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:28.280347 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3d3225af-29ca-4884-be28-9448af26f2c8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.290933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3d3225af-29ca-4884-be28-9448af26f2c8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1219 microversion: 2.1 time: 0.115119 Aug 24 14:42:28.291940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 108/213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:28 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:29.049583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:29.051666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:29.062115 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.062724 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.063418 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.064240 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.064908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.065344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.248777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.260597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ebb3e317-6336-49d5-87e5-3c4d2a5021fe tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1501 microversion: 2.1 time: 0.218337 Aug 24 14:42:29.262580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 106/214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:29 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:29.302456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:29.303312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:29.312832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:29.313447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:29.320059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.320949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.321824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.323234 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.323916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.324377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.330300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.331559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.332655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.334499 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.336377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.337205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.447519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.457470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7765aefc-730b-43e9-aa5b-6e9af76f2577 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1271 microversion: 2.1 time: 0.148183 Aug 24 14:42:29.458681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 107/215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:29 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:29.582172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.600231 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-af2d00af-0569-4e80-b06a-680604aad892 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1515 microversion: 2.1 time: 0.305615 Aug 24 14:42:29.601311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 109/216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:29 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:30.483582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:30.484437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:30.495849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.496730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.497537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.498817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.499810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.500737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.608545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:30.621878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6c0805a3-65f2-4e45-9d54-0f5d4b7fb494 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1277 microversion: 2.1 time: 0.144828 Aug 24 14:42:30.640862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 108/217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:30 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:31.320117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:31.324786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:31.340623 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.341803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.342824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.344214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.345180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.346054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.388267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'flavor' on Instance uuid 618665e1-aacd-4ca7-873b-a47102ccfcb1 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:31.533571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-69f1c8af-c86b-43ee-a0bd-98145bfbb26d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/action" status: 200 len: 32 microversion: 2.1 time: 0.218619 Aug 24 14:42:31.534288 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 110/218] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:42:31 2022] POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:42:31.547403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:31.548602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:31.559485 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.560061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.560848 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.561851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.562331 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.562789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.668307 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:31.669012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:31.680861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.681536 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.682132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.683410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.684236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.685459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.860236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:31.881868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f8393416-abe3-40dc-bc3a-2a0a1d91989b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.340134 Aug 24 14:42:31.882686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 109/219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:31 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:32.043000 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:32.053905 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6176f3cc-7b50-4594-ab98-97030edb914a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.392143 Aug 24 14:42:32.054849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 111/220] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:31 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:32.235121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73cc064-c946-4358-83cd-a2f54a70e65e", "tag": "2ed6a118-9abe-4829-87ab-cef127cf00b1"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:32.252974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.254073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.255191 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:32.280001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] Creating event network-changed:2ed6a118-9abe-4829-87ab-cef127cf00b1 for instance d73cc064-c946-4358-83cd-a2f54a70e65e on hv-cinder-84889 Aug 24 14:42:32.292905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-8915d4ca-73dd-4a7e-b9ef-e505b5efa925 req-866da26b-facd-46db-8030-7bf05a8d1a41 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062752 Aug 24 14:42:32.293734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 110/221] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:32.914571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:32.915643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:32.923576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.924096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.924694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:32.925432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.925884 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.926332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.090602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:33.091325 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:33.101728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:33.102627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:33.103396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.104672 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:33.105473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:33.106202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.127171 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.136983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-797b24f8-0df7-4eeb-b5e1-1ec08b9a2795 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.226838 Aug 24 14:42:33.137751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 112/222] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:32 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:33.279523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.294244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8e3b4f9d-36e1-4a8e-b5ce-6cc1ad00657a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.211756 Aug 24 14:42:33.295085 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 111/223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:33 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:34.165786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:34.167695 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:34.178157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.179432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.180170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.181578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.182336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.183151 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.318356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:34.320474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:34.341277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.341788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.342233 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.343759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.344235 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.344668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.355780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:34.399208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:34.420543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-18e1aaa1-6fd4-4ff7-86ec-ac39072302d5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.261698 Aug 24 14:42:34.421251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 113/224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:34 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:34.994168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.002483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-148d05bc-4bc7-48e9-991f-5d3acaebc21c tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.688580 Aug 24 14:42:35.003380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 112/225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:34 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:35.448622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:35.449793 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:35.458650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:35.459604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:35.460308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:35.461440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:35.462424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:35.462841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:35.661332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.682453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e55b5c5e-a996-4069-a250-3df6ea9c9bc3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.240784 Aug 24 14:42:35.684014 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 114/226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:35 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:36.024165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:36.024859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:36.032211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.032694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.033464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.034250 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.034752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.035173 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.267079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:36.276531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-91243959-1ae4-4e44-b569-f52f5054ce71 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.256150 Aug 24 14:42:36.277429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 113/227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:36 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:36.712051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:36.712741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:36.719158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.719642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.720069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.721056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.721873 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.722626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.908076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:36.920783 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1ba97933-e808-4500-8998-7c1ece6c0097 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.212684 Aug 24 14:42:36.921433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 115/228] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:36 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:37.302189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:37.304474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:37.309174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.309648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.310075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.310792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.311271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.311640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.485331 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:37.494123 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad24d43b-965d-46d4-bef4-195e80282853 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.196651 Aug 24 14:42:37.494920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 114/229] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:37 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:37.945379 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:37.946389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:37.955031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.955784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.956555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.957745 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.958667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.959408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.989930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:38.174050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:38.184227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b316d6b3-6c9c-427e-bc91-0ed31098d0cc tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.244945 Aug 24 14:42:38.184805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 116/230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:37 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:38.517045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:38.517799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:38.519652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:38.520355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:38.526545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.527046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.527467 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:38.528165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.528604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.529018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:38.718443 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:38.728838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6e88e2f1-2abf-4dc9-b904-a53d39cd37c3 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.216306 Aug 24 14:42:38.729746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 115/231] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:38 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:39.207282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:39.208285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:39.211038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:39.219157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.220280 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.221324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.222568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.223283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.223961 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.425802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.441436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bbd1e594-b03d-42c9-8948-f1adfa8e0fca tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.239282 Aug 24 14:42:39.442845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 117/232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:39 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:39.754065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:39.755447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:39.764012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.764218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.764816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.765934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.766907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.767570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.961452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.977234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-74381919-0563-492a-9caf-ae0d7684db75 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.229031 Aug 24 14:42:39.977871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 116/233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:39 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:40.462751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:40.463438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:40.473265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.474244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.474952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.476108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.476846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.477509 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.659464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:40.671499 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-132393a8-f684-4287-8141-36cf85216f76 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.212390 Aug 24 14:42:40.672460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 118/234] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:40 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:41.018972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:41.019671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:41.026228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.027398 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.027834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:41.028569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.029051 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.029496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:41.236334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:41.245533 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-62f8935d-c851-4058-8dd2-1581d61510af tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.231260 Aug 24 14:42:41.246873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 117/235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:41 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:41.453968 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73cc064-c946-4358-83cd-a2f54a70e65e", "name": "network-vif-plugged", "status": "completed", "tag": "2ed6a118-9abe-4829-87ab-cef127cf00b1"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:41.470373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.471441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.472361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:41.488743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] Creating event network-vif-plugged:2ed6a118-9abe-4829-87ab-cef127cf00b1 for instance d73cc064-c946-4358-83cd-a2f54a70e65e on hv-cinder-84889 Aug 24 14:42:41.496750 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-d8aa64f1-f3bc-477b-b773-cc2345c80c26 req-a53a0ee9-ce96-4e90-afab-6cc0657960cd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049743 Aug 24 14:42:41.498334 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 119/236] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:41.696407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:41.697947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:41.708662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.709947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.710966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:41.712279 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.713217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.714008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.021805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.032796 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d508202c-6215-4b58-917b-24fbe21a376c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.343155 Aug 24 14:42:42.033470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 118/237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:41 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:42.282886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:42.283487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:42.289927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:42.290397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:42.290865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.291541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:42.291980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:42.292390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.519667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.529925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b2960fcf-ad29-4d09-a11a-b9ee55d4e1ac tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.252847 Aug 24 14:42:42.530545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 120/238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:42 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:43.060674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:43.062181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:43.069744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.070567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.071614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.073463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.073818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.074860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.277536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.292574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-24856599-5c9b-4075-af50-a8b350273bb6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.235694 Aug 24 14:42:43.293384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 119/239] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:43 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:43.554006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:43.555183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:43.563510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.564119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.564608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.566146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.566454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.567256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.807323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.824135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-28ed47a9-a752-40c4-84cc-ba97faa796f1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1319 microversion: 2.1 time: 0.270087 Aug 24 14:42:43.824135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 121/240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:43 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:44.286188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:44.287907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:44.306188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.313052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.314439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.318275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.320469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.321476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.343133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:44.346848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:44.366031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.367305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.368080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.369175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.369685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.370269 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.392123 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-851cbf92-0f36-4fd7-9684-ddbcd0aa7ffc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/ips" status: 200 len: 147 microversion: 2.1 time: 0.112180 Aug 24 14:42:44.393331 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 120/241] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:42:44 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/ips => generated 147 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:44.585446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:44.606451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f70ac742-1570-4295-90bd-7e7570e7f419 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.275071 Aug 24 14:42:44.620639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 122/242] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:44 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:44.851387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:44.856117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:44.863045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.863528 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.863974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.864743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.865360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.865960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:45.150077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:45.161503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fa972db9-aa03-4eb6-b210-c31bd8d4ff4a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1508 microversion: 2.1 time: 0.316717 Aug 24 14:42:45.162989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 121/243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:44 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:45.644729 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:45.646436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:45.677222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:45.679484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:45.681756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:45.683923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:45.685449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:45.686861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:46.036002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:46.053770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-99676caa-94db-4335-9cf6-5b5e9cb0deb4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.416360 Aug 24 14:42:46.054421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 123/244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:45 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:47.101444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:47.107827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:47.133576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:47.134862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:47.136079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:47.138821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:47.139546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:47.140320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:47.408437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:47.418217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-031e3bf7-c22a-498b-9451-266bbc7b2247 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.333169 Aug 24 14:42:47.419231 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 122/245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:47 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:48.470842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:48.471719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:48.485142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.485823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.486461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.487763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.488402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.489017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.744367 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:48.756595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3ee4eaa6-cb8a-43dd-9b70-dd7109a98b81 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.294739 Aug 24 14:42:48.757513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 124/246] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:48 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:48.883676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53805fd3-525f-46c1-8b6e-98f0c6234417"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:48.886166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:48.888815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:48.896060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.896589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.897280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.898030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.898644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.899210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:49.329259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8c948550-93ea-485c-aa65-9ba18d68a81a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449713 Aug 24 14:42:49.330336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 123/247] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:42:48 2022] POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:49.784719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:49.786780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:49.792036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=46 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:49.798096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:49.798830 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:49.799495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:49.800200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:49.801490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:49.801977 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:50.029555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:50.055993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6f79642-40c0-45f0-a65c-780897d379af tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.277674 Aug 24 14:42:50.057902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 125/248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:49 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:51.079417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:51.080242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:51.087243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:51.087726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:51.088206 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:51.089002 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:51.089523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:51.090023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:51.264238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:51.273045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-33d336b5-b6ae-4dcb-b702-443f3784a42b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.198778 Aug 24 14:42:51.273730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 124/249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:51 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:52.294704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:52.295685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:52.302983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:52.303817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:52.304305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:52.305090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:52.305554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:52.305974 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:52.457953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:52.470207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-92df0d1a-9818-4d10-8439-9f923afb954b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.179040 Aug 24 14:42:52.471274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 126/250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:52 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:53.492570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:53.493371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:53.500710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:53.501197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:53.501622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:53.502315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:53.502903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:53.503345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:53.876176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:53.890851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a3edd7a-78b0-43e7-8d2b-4ecc527a04ed tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.402077 Aug 24 14:42:53.892237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 125/251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:53 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:54.920341 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:54.922411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:54.932877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:54.933705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:54.934842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:54.936466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:54.937215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:54.938221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:55.108769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:55.117598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-63deb0bf-9014-4dde-8a3a-29c3e782bc0b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.204261 Aug 24 14:42:55.118045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 127/252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:54 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:56.143369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:56.145767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:56.155967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:56.157017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:56.157731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:56.159214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:56.160137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:56.160957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:56.398275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:56.411075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8a5bd513-0920-4e51-b0e4-4b692264bee2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.275123 Aug 24 14:42:56.411751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 126/253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:56 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:57.438885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:57.440902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:57.452509 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.453281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.454026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.455627 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.456739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.457430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.691458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:57.705217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6ba7e53a-7d3b-4f15-837f-66f18c796879 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1501 microversion: 2.1 time: 0.273969 Aug 24 14:42:57.706192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 128/254] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:57 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:57.741893 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f419c8-0052-44f3-8475-a3b27967e3c7"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:57.748748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:57.761375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.763683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.765174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.767218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.768184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.768917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.808098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] HTTP exception thrown: Cannot 'attach_volume' instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 while it is in vm_state rescued Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Request method failure captured: Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/os-volume_attachments HTTP/1.1 Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 74 Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhuSgEoowesTUETXCMXkefDEzMPfYQQutwmxZaFStHtasQklb6IOHxEZSVYbxi8EHg5NJztgMcuse4M4Y2cInmWTzQ2YTi1tz8yMRq11DFVqCGWmqFNnl6MJwzSHsPEputZjZUK4FQzn94IFqyJD_MnBmY7V2f0Oz1QCuXosjRCdDU Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:42:57.810746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d39aed3397c47b7a361a0036c2f0eeb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 9cef72df53e14cc39db936f6737d842c Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {"volumeAttachment": {"volumeId": "83f419c8-0052-44f3-8475-a3b27967e3c7"}} Aug 24 14:42:57.815194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Cannot 'attach_volume' instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 while it is in vm_state rescued Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'server_id': '618665e1-aacd-4ca7-873b-a47102ccfcb1', 'body': {'volumeAttachment': {'volumeId': '83f419c8-0052-44f3-8475-a3b27967e3c7'}}} Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:57.816611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 while it is in vm_state rescued Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:57.818915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 while it is in vm_state rescued Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Returning 409 to user: Cannot 'attach_volume' instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 while it is in vm_state rescued {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-de377afa-38eb-43a9-b246-b0fe04934cf6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084837 Aug 24 14:42:57.822633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 127/255] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:42:57 2022] POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 14:42:57.826056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:57.826655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:57.833080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.833940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.834489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.835248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.835737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.836249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.947018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-015ca9c4-c550-4445-b3fd-d145e027f5d7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/action" status: 202 len: 0 microversion: 2.1 time: 0.124214 Aug 24 14:42:57.948588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 129/256] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:42:57 2022] POST /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:42:57.958297 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:57.958946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:57.965652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.966150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.966696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.967664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.968130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.968559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.971872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:58.171665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:58.180188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5491bf89-f67b-4a80-915b-d929284da4e4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.226011 Aug 24 14:42:58.180988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 128/257] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:57 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:59.203073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:59.203895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:59.211494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:59.212218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:59.212857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:59.213911 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:59.214621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:59.215268 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:59.379740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:59.388993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-956ed6cd-006d-42dd-b150-277ae35a11fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.190195 Aug 24 14:42:59.389632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 130/258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:59 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:00.414827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:00.415718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:00.423164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.423713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.424291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.425150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.425687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.426156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.598852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.614466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-524c82e8-f812-443d-b6ee-ae60e525d33c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.204454 Aug 24 14:43:00.615511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 129/259] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:00 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:01.640912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:01.643241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:01.652285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.653059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.653775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:01.654764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.655861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.656524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:01.902289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:01.916981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ecf37ea8-86ee-4525-b8d3-12799c3e165f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.280685 Aug 24 14:43:01.917998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 131/260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:01 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:02.510010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:02.516887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.517370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.517811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.583217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Going to try to stop instance {{(pid=127297) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:43:02.634213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d484c7bf-38fa-4fbc-9b31-0b14deede67f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action" status: 202 len: 0 microversion: 2.1 time: 0.129044 Aug 24 14:43:02.635058 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 130/261] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:43:02 2022] POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:43:02.646957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:02.648013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:02.658186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.659001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.659679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.660805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.661562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.662270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.824428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:02.828408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:02.838406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b0a337a4-97db-487f-8198-c88e18bd161f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.196954 Aug 24 14:43:02.839512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 132/262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:02 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:02.945285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:02.945958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:02.953335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.953807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.954242 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.954997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.955804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.956575 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:03.138668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.151117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-83d3d72b-bb27-4456-b058-aee1bb7d417b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.210060 Aug 24 14:43:03.152194 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 131/263] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:02 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:03.873510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:03.874351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:03.882858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:03.883470 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:03.883985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:03.884788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:03.885412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:03.885975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.104507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.122785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ef537d66-9a3a-4295-b7f6-0110cb8eb5c1 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.254131 Aug 24 14:43:04.123362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 133/264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:03 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:04.189036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:04.192252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:04.206599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.207463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.208143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.209280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.210427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.211010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.407140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.421355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bca62b34-3a57-4a08-9ddd-08642543d30f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1509 microversion: 2.1 time: 0.239423 Aug 24 14:43:04.422295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 132/265] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:04 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:05.146374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:05.147851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:05.157222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.157823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.158489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.159556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.160138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.160652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.352516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.363691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d42b7054-cc01-4fe2-8a63-ad460959003a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.222279 Aug 24 14:43:05.364496 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 134/266] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:05 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:05.453109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:05.453784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:05.463915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.464723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.465431 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.466627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.467407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.468140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.643617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.653665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6ff5620b-696b-406b-9630-e9d79d6b6f8b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1515 microversion: 2.1 time: 0.204517 Aug 24 14:43:05.654330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 133/267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:05 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:06.390854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:06.390854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:06.397021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.397497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.398328 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:06.399059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.399511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.399920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:06.557540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:06.570502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d53593ec-6f4f-4cb5-bc82-64c8fcec7a4c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.184891 Aug 24 14:43:06.571546 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 135/268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:06 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:07.097281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-135e67e8-149e-4520-8bdb-15bec7dab842 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: .version_select at 0x7f8749c15e50>, body: {"keypair": {"name": "tempest-keypair-1657957897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0BzoLkz6L9fRnOGgYi16ULZwg5ivwp8pj5nrSEWkYqWwtZ8r4CwgToyrIxlms2HTCnJHaM2BlrDPF5mgLOBU4afM1IV8fxDKUvsBOXy+bD1traeQ4e/ZV8gDZ71uTkIA=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:07.117888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-135e67e8-149e-4520-8bdb-15bec7dab842 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:43:07.123621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-135e67e8-149e-4520-8bdb-15bec7dab842 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for user 9cef72df53e14cc39db936f6737d842c and project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:43:07.167863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-135e67e8-149e-4520-8bdb-15bec7dab842 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074911 Aug 24 14:43:07.168721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 134/269] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:43:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:07.597867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:07.598737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:07.607117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:07.608174 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:07.608174 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:07.608918 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:07.609340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:07.609760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:07.823857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:07.835954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d32225b1-637b-4332-be0a-f856fb90fe11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.244943 Aug 24 14:43:07.836549 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 136/270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:07 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:08.874028 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:08.875612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:08.885641 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:08.886319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:08.886962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:08.888440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:08.889113 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:08.889628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:08.907325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2128228673", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acfa551b-70ba-4d4e-abd4-a205f44489e0"}], "security_groups": [{"name": "tempest-securitygroup--1816016335"}], "key_name": "tempest-keypair-1657957897", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:09.091033 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:09.103954 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-94dd17b9-58cf-4a9a-bfc9-a9a9da36287c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.238996 Aug 24 14:43:09.104549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 135/271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:08 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:10.125879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:10.125879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:10.135920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:10.136561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:10.137096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:10.138048 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:10.138773 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:10.139290 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:10.306999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:10.318045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6169742b-4476-4d0b-91dc-814778d53e3c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.196186 Aug 24 14:43:10.318665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 136/272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:10 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:11.340366 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:11.341079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:11.348292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.348775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.349218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.349901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.350364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.350809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.492362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:11.501427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2af0e4d-3533-4a0f-920b-708b76fcec1d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.165076 Aug 24 14:43:11.502090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 137/273] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:11 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:12.524760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:12.525737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:12.537264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:12.538155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:12.538929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:12.540133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:12.540916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:12.541696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:12.773662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:12.809429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5cacf344-d31a-487e-bebd-1a61cb6a1fd2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.288172 Aug 24 14:43:12.820382 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 138/274] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:12 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:12.865415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] validate_networks() for [('acfa551b-70ba-4d4e-abd4-a205f44489e0', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:43:13.669246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:43:13.669959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:43:13.670817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:43:13.671505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:43:13.672071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:43:13.684928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.685402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.685823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.686566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.686999 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.687406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.704951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:43:13.709317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Getting quotas for user 9cef72df53e14cc39db936f6737d842c and project 6d39aed3397c47b7a361a0036c2f0eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:43:13.721746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:43:13.724473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:43:13.777717 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-202f4cac-3c65-48ae-b9aa-f4f4aa79e8ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.874943 Aug 24 14:43:13.778358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 137/275] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:43:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 4877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:43:13.790741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a0e57e2b-cddc-467a-85f5-bb985169d776 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:13.791680 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a0e57e2b-cddc-467a-85f5-bb985169d776 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:13.855710 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:13.860294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:13.887935 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.891003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.892107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.895208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.898097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.898994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.915315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a0e57e2b-cddc-467a-85f5-bb985169d776 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:13.941689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a0e57e2b-cddc-467a-85f5-bb985169d776 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1246 microversion: 2.1 time: 0.154857 Aug 24 14:43:13.943636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 139/276] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:13 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1246 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:14.109744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:14.124212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8496e8c5-9634-41ad-800e-a9f02cdca271 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.278712 Aug 24 14:43:14.125166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 138/277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:13 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:14.969645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:14.970558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:14.982741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.983652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.984409 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:14.985651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.986476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.987279 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.076069 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:15.086374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-408e6af5-1492-45a4-b794-e66abebe71c0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1298 microversion: 2.1 time: 0.123646 Aug 24 14:43:15.086991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 140/278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:14 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:15.160511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:15.161660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:15.181271 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.182090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.182874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.184046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.184841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.185554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.371225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:15.382103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-57a62509-aec4-4c6b-8b96-f1a5e6e110bb tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.227629 Aug 24 14:43:15.382807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 139/279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:15 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:16.117878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:16.118795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:16.131439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.132366 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.133399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.134990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.136052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.136732 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.241746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.253660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-78ae6060-7ee7-4c98-88e5-9e701048a828 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1304 microversion: 2.1 time: 0.141346 Aug 24 14:43:16.254673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 141/280] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:16 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:16.415088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:16.416372 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:16.432194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.432734 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.433596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.435508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.436263 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.437015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.599217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.614553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-398fe228-01c9-4819-9f89-f36faa517bff tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.204610 Aug 24 14:43:16.615749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 140/281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:16 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:17.282709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:17.283898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:17.295883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.296617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.297335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.298637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.299730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.300478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.541914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:17.551301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-16c6e201-beb1-4b45-a711-72f7f97f7496 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.278242 Aug 24 14:43:17.551781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 142/282] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:17 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:17.654782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:17.655953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:17.667724 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.668797 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.669947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.671061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:17.672734 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.673398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.674458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.689102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.690067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.690946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.716210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] Creating event network-changed:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:43:17.723310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-f06d9faa-af80-44ec-89e0-c43165fd01f3 req-d8efe0ed-c7ef-4b0d-a8d6-1296b783c3d4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062177 Aug 24 14:43:17.724440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 143/283] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:17.896019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:17.906588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-db9f69a6-ecdb-43c9-9d93-aa3c6bc6ab95 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.259645 Aug 24 14:43:17.918544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 141/284] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:17 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:18.585741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:18.586953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:18.598675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.599567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.600328 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.601663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.602494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.603268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.814486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:18.827154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ff5e6a2a-b456-4a7d-9128-4df3aee7d939 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.248548 Aug 24 14:43:18.828252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 144/285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:18 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:18.944260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:18.945212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:18.952527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.953193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.953625 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.954367 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.954885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.955320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.126571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:19.141126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-03b406c4-57d6-44b2-b3a0-7fd2d677e46c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.200848 Aug 24 14:43:19.142342 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 142/286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:18 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:19.865364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:19.866599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:19.871396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:19.881828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.882746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.883540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.885467 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.885467 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.886253 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.062079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.071675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7fa7e3f6-2ed2-4618-bc4b-f4985fc036fd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.213477 Aug 24 14:43:20.072564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 145/287] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:19 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:20.178583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:20.179961 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:20.182333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:20.189092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.189873 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.190693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.191921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.192700 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.193447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.413358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.424310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6abad9a2-d27b-4b46-93f5-49666069938f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.252923 Aug 24 14:43:20.425491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 143/288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:20 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:21.105904 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:21.106684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:21.116803 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.117561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.118256 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.119131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.119624 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.120293 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.139139 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:21.294200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:21.305090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9abbb802-88c0-48be-89b5-b01d1d068307 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.206190 Aug 24 14:43:21.305680 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 146/289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:21 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:21.457237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:21.458603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:21.470957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.472489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.473500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.474589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.475478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.476257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.661076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:21.671667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-128ad661-2cec-4023-9c94-dfe8dd1b77ab tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.224972 Aug 24 14:43:21.672260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 144/290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:21 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:22.329765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:22.330807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:22.345284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.346212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.346966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.348164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.348861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.349392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.542801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:22.557506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d7d2f686-3acb-49b3-9498-9ff483c4878d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.233593 Aug 24 14:43:22.559442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 147/291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:22 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:22.599508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa6a54b-4ccc-4d03-9dc9-bca7fdea4abd", "device": "/dev/sdb"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:22.602469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:22.611524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.612281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.612991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.614042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.614788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.615474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.706610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:22.708027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:22.717114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.718145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.719215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.720392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.721295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.721889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.947822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:22.965339 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f5659cc-f477-4f32-b3e7-0822c0ea140d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.265033 Aug 24 14:43:22.966165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 148/292] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:22 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:23.287362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-356cd83f-11a7-4d01-a4b0-d28e13df6000 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "POST /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691746 Aug 24 14:43:23.288045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 145/293] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:43:22 2022] POST /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:23.582887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:23.585000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:23.598642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.600149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.601806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.602499 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.603335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.604397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.824287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:23.832522 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f9564de6-381d-4b23-ac53-d1da3d627650 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.256506 Aug 24 14:43:23.833147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 149/294] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:23 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:23.860415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "name": "network-vif-plugged", "status": "completed", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:23.869290 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:23.870045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:23.878382 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.879312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.879956 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.897782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] Creating event network-vif-plugged:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:43:23.905831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-5b6b108b-cd74-405d-8245-4c4b323d10a3 req-8298730c-25d7-4b8a-85c1-f2379d0d9a17 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050284 Aug 24 14:43:23.907062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 146/295] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:23.993344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:23.993652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:23.999322 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:24.001148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.001702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.002807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.003563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.004091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.004543 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.225653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:24.239896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7543b772-9b01-46da-aa24-b9de843095cd tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1726 microversion: 2.1 time: 0.252937 Aug 24 14:43:24.240770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 150/296] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:23 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:24.874099 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:24.875420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:24.886278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.887142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.887812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.888898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.889493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.890103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.087757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.097946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6714af74-4002-42ee-80b7-26c53bb61c09 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.230966 Aug 24 14:43:25.098622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 147/297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:24 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:25.265977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:25.267195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:25.275709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.276303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.276862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.277585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.278160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.278474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.438225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.452145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5b0c2fbb-778d-4a89-84d4-cabd5ff8bc29 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1703 microversion: 2.1 time: 0.190296 Aug 24 14:43:25.452747 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 151/298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:25 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1703 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:25.480626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:25.487706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.488193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.488620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.576357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Going to try to start instance {{(pid=127296) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:43:25.611689 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:25.644373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6527feae-6b32-4d74-9844-2e888e2ce451 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action" status: 202 len: 0 microversion: 2.1 time: 0.174120 Aug 24 14:43:25.645011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 148/299] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:43:25 2022] POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:43:25.657236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:25.658472 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:25.669160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.670083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.670968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.672532 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.673663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.674432 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.875933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.891592 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d3a55c40-ccdd-44f6-99d5-fe13e414e03a tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.240941 Aug 24 14:43:25.892384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 152/300] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:25 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:26.119603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:26.120201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:26.136669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.137480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.138271 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.140683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.141790 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.142278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.323967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:26.332025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-10b03ef9-e1b1-4f39-9a37-99fa84ee6fec tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.216755 Aug 24 14:43:26.332616 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 149/301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:26 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:26.917897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:26.918828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:26.933462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.934121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.934744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.935469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.935922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.936536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:27.137170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:27.142851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e705dabc-deb3-480f-ad4e-5f9103166b31 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.230594 Aug 24 14:43:27.143443 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 153/302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:26 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:27.358354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:27.359559 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:27.366487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:27.367188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:27.367620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:27.368323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:27.368770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:27.369176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:27.535970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:27.548235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-99948074-b9f1-4266-b3c4-7598a0ba434c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.193593 Aug 24 14:43:27.548937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 150/303] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:27 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:28.175894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:28.176900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:28.184334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.184817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.185247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.185944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.186395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.186840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.345637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:28.357516 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-23049e08-92cf-4d37-846e-e0abaecb0336 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.186975 Aug 24 14:43:28.358254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 154/304] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:28 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:28.570227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:28.571131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:28.580952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.581622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.582301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.583160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.583613 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.584188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.779865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:28.788397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b56b3679-1e7a-42fb-8b23-ac212fee33ff tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1372 microversion: 2.1 time: 0.222521 Aug 24 14:43:28.788970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 151/305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:28 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:29.382006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:29.383266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:29.395558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.396349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.397031 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:29.398181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.399048 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.399798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:29.628927 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:29.643417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bf27d527-bd3f-4b8d-9119-e4fd2b91b225 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.267207 Aug 24 14:43:29.644031 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 155/306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:29 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:29.816584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:29.817598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:29.829831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.830657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.831361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:29.832548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.833269 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.833997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.211141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:30.221943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fae6d5fe-adeb-4998-b64c-7900dfa5f2aa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1567 microversion: 2.1 time: 0.412704 Aug 24 14:43:30.223007 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 152/307] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:29 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:30.256170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:30.256817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:30.263195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.263720 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.264162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.264915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.265381 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.265821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.424743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0d0aa6ab-d127-47f7-9136-0d08a71ba562 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173569 Aug 24 14:43:30.425743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 156/308] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:43:30 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:30.670577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:30.671653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:30.684750 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.685665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.686397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.687445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.688065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.688583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.920784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:30.940366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-59c798ee-6d32-41ed-ab0b-0f0e364e57c0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.276878 Aug 24 14:43:30.942220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 153/309] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:30 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:31.969658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:31.971960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:31.986585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:31.987408 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:31.988183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:31.989405 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:31.990207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:31.991052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:32.066529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:32.093775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:32.095005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:32.095699 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:32.112901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] Creating event network-changed:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:43:32.121461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-e38024d1-1c3b-4161-b657-263ceac1e1bd req-347c6346-0982-4400-a5a8-4c200248509f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058646 Aug 24 14:43:32.122655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 154/310] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:43:32.238331 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:32.254316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f5fe9e6-4bb8-4be7-af55-22fb65fb19f3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1712 microversion: 2.1 time: 0.291006 Aug 24 14:43:32.255367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 157/311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:31 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1712 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:33.289681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:33.292995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:33.327129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:33.327942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:33.328661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:33.329838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:33.330583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:33.331633 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:33.624785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:33.658952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9dff7f2b-ee13-4f77-b318-b202a3205b22 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1716 microversion: 2.1 time: 0.377232 Aug 24 14:43:33.671395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 155/312] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:33 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1716 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:54.070799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=25 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:54.072047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=67 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:54.080116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:54.080995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:54.091035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:54.091572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:54.092084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:54.092816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:54.093303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:54.093766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:54.239515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lazy-loading 'services' on Instance uuid d73cc064-c946-4358-83cd-a2f54a70e65e {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:43:54.372451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-48d9dad5-745c-43d2-8aec-13af55952f17 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e/os-volume_attachments/9aa6a54b-4ccc-4d03-9dc9-bca7fdea4abd" status: 202 len: 0 microversion: 2.1 time: 0.303587 Aug 24 14:43:54.373454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 158/313] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:43:54 2022] DELETE /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e/os-volume_attachments/9aa6a54b-4ccc-4d03-9dc9-bca7fdea4abd => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:43:56.621161 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:56.621821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:56.627969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=25 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:56.629129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:56.630749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.631542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.632207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:56.633139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.633787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.634421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:56.665104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:43:56.771420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2c99935c-e50e-49ea-bd89-1ec9d54211b1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 204 len: 0 microversion: 2.1 time: 0.154324 Aug 24 14:43:56.776677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 156/314] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:43:56 2022] DELETE /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:43:56.785385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:56.786089 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:56.794972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.795841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.796748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:56.797870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.798338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.798812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:57.020052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:57.030221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9afa22e1-453b-49d1-becf-3ef76f37a4d8 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1514 microversion: 2.1 time: 0.250750 Aug 24 14:43:57.030765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 159/315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:56 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:58.060445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:58.061954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:58.069606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:58.070410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:58.071079 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:58.071820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:58.072279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:58.072701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:58.308800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:58.325744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b66a083-994e-4bdf-b187-69d2aa3a955f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1514 microversion: 2.1 time: 0.270817 Aug 24 14:43:58.327205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 157/316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:58 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:58.935171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1050555314", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:59.049583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] validate_networks() for None {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:43:59.355245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:59.356006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:59.363423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.364003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.364490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.365345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.365710 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.366380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.568369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:59.578025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9a14a2e0-8b93-42f3-9c69-c086b64b707e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1514 microversion: 2.1 time: 0.227290 Aug 24 14:43:59.578926 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 158/317] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:59 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:59.870911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:43:59.872272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:43:59.872952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:43:59.873550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:43:59.874223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:43:59.889114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.890102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.890277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.891702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.892704 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.893301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.922494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Getting quotas for project cd86121e69094a149766cfd767819791. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:43:59.933956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Getting quotas for user 0deb8f087ea448debe87c3c28a05db35 and project cd86121e69094a149766cfd767819791. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:43:59.958397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:43:59.962044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:00.027615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fc71f029-c1c8-415d-8515-d5fcd9f3e15e tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099586 Aug 24 14:44:00.042735 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 160/318] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:44:00.043804 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-94680577-29ea-46af-8e86-1e9fdffe4bef tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:00.044535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-94680577-29ea-46af-8e86-1e9fdffe4bef tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:00.125060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-94680577-29ea-46af-8e86-1e9fdffe4bef tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:00.134215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-94680577-29ea-46af-8e86-1e9fdffe4bef tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1215 microversion: 2.1 time: 0.095396 Aug 24 14:44:00.151033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 159/319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:00 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:00.605966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:00.606875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:00.619759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.620236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.621329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.624269 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.624965 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.625864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.946694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:00.967094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d643b214-8a75-4773-a9a3-dd26616dc289 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1514 microversion: 2.1 time: 0.368845 Aug 24 14:44:00.971313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 161/320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:00 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:01.004658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73cc064-c946-4358-83cd-a2f54a70e65e", "name": "network-vif-deleted", "tag": "2ed6a118-9abe-4829-87ab-cef127cf00b1"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:01.031063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.031572 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.033307 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.061965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] Creating event network-vif-deleted:2ed6a118-9abe-4829-87ab-cef127cf00b1 for instance d73cc064-c946-4358-83cd-a2f54a70e65e on hv-cinder-84889 Aug 24 14:44:01.072419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-a92a4894-35c4-4f83-883b-765e6fa5bd00 req-99b4bdca-e990-4dba-abfb-e831fbd7edf7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070739 Aug 24 14:44:01.074422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 160/321] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:01.159615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:01.161622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:01.176881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.177926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.179854 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.181218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.182030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.182786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.286203 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:01.298280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-77f035f7-f4a2-4007-9b4b-6e8aea4c21be tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1211 microversion: 2.1 time: 0.144395 Aug 24 14:44:01.300548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 162/322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:01 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1211 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:01.991038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:01.992141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:01.999387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.999950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.000395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.001807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.001807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.003381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.060576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.061454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.061454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.061927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lazy-loading 'fault' on Instance uuid d73cc064-c946-4358-83cd-a2f54a70e65e {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:02.177420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:02.186177 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-426ea032-d53b-4c85-b149-b496a4000be9 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 200 len: 1309 microversion: 2.1 time: 0.199651 Aug 24 14:44:02.187385 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 161/323] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:01 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:02.327581 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:02.328438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:02.336355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.337122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.337781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.338690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.339145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.339553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.417286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:02.426997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ef7a5cc8-40b9-4c68-8f80-c46bb6ed248f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1267 microversion: 2.1 time: 0.106725 Aug 24 14:44:02.427942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 163/324] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:02 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:03.216465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:03.219091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: d73cc064-c946-4358-83cd-a2f54a70e65e] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:03.233154 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.237763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.238250 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.239548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.240578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.241483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.274842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] HTTP exception thrown: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Request method failure captured: Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e HTTP/1.1 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjjRofxyvP2xiBlJ2dsiY3j8motgKmxUlZXmqf7YIOyvGK19dLVnBMnaL1ALg9EyQBnkUnfklgrEIkxDRwgnr-llu3fJvpfudcV4ufqA8PWO8idsQRsoOcfogNyHCoIex9coj-orVJ-j7hIxXzTs3J_FIJmDwLVj4a-Q-D2Jnypj8wM Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 21471957737c4c42949ad067de224cf8 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:44:03.286626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21471957737c4c42949ad067de224cf8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21471957737c4c42949ad067de224cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21471957737c4c42949ad067de224cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21471957737c4c42949ad067de224cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 21471957737c4c42949ad067de224cf8 Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesSnapshotTestJSON-2057422698-project Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: dc387b373c2544b3b39feb0cddfbb585 Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesSnapshotTestJSON-2057422698-project Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. Aug 24 14:44:03.288566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'd73cc064-c946-4358-83cd-a2f54a70e65e'} Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:44:03.294274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. Aug 24 14:44:03.301704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.303748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Returning 404 to user: Instance d73cc064-c946-4358-83cd-a2f54a70e65e could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:44:03.303748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b32946f-bd75-4f2d-8331-a866795bf27f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e" status: 404 len: 111 microversion: 2.1 time: 0.081039 Aug 24 14:44:03.303748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 162/325] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:03 2022] GET /compute/v2.1/servers/d73cc064-c946-4358-83cd-a2f54a70e65e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:44:03.449665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:03.450929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:03.462186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.463101 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.464249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.465380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.466205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.466820 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.628861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:03.656861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b9ccdeb-f6b5-4dad-a031-d355172af41c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1273 microversion: 2.1 time: 0.211545 Aug 24 14:44:03.667432 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 164/326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:03 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:04.686427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:04.689449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:04.700793 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:04.701777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:04.702484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:04.704289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:04.705522 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:04.706685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:04.971843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:04.983446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-572f64a2-38e6-45fc-abf1-7c62a8db2577 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.302824 Aug 24 14:44:04.984579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 163/327] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:04 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:06.007370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:06.008613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:06.025104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:06.025833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:06.026502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:06.027438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:06.028100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:06.028679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:06.245038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:06.254293 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ec2e317d-644f-4adb-a0d1-9dc5a61844de tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.252310 Aug 24 14:44:06.255181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 165/328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:06 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:07.277500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:07.280043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:07.297329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.298108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.298673 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.302332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.303351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.303980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.595956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b48cd60-f289-4e6a-9b56-eb20f72300d4", "tag": "4f4c0736-9fd5-4c31-96be-5d2eec4f3800"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:07.635138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.638287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.640348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.671937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] Creating event network-changed:4f4c0736-9fd5-4c31-96be-5d2eec4f3800 for instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 on hv-cinder-84889 Aug 24 14:44:07.690571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9bdbdc17-4177-4c6f-96b2-26168b65e276 req-09535ed7-0e0f-4e54-a3bd-a35d7a9f870f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100521 Aug 24 14:44:07.694458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 166/329] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:07.713903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:07.728552 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2419f045-af80-44fa-a994-b190d5aaa6ae tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.456293 Aug 24 14:44:07.731079 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 164/330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:07 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:08.758236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:08.759505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:08.768899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.769389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.769805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.770723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.771411 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.772064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.982920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:09.001922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-079a6e61-f2b2-4f7e-951b-370dbbe32048 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.247639 Aug 24 14:44:09.003294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 167/331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:08 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:10.027120 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:10.027777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:10.030261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:10.033999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:10.040618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:10.041542 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:10.042148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:10.042977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:10.043435 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:10.043883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:10.129931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:10.195774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:10.204603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1c1ece09-38fa-4bd1-a91e-4f0df4534e2f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.183882 Aug 24 14:44:10.219107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 168/332] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:10 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:10.223694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-aae2afc4-d248-4212-922f-d740842f7fac tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Action: 'create', calling method: .version_select at 0x7f8749c61790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1919046976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKla4OluzQTULmmExUi3ec+RvE0FOTtHeqD+5/OjeMg7KxKhFP8hEDXO86qdQ4JvXlri3Shw5cxOZnNUXrX4KpvxerG3tSspgpNl9GdupJcV/5aMuabYx9EZjq1901teIA=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:10.245305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-aae2afc4-d248-4212-922f-d740842f7fac tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Getting quotas for project 8c14444d5dc04d1a80d159f6ca0a64db. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:10.249530 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-aae2afc4-d248-4212-922f-d740842f7fac tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Getting quotas for user e646bfca226747cc8c6ae44371008317 and project 8c14444d5dc04d1a80d159f6ca0a64db. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:10.288383 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-aae2afc4-d248-4212-922f-d740842f7fac tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.286372 Aug 24 14:44:10.289539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 165/333] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:44:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:11.225576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:11.226177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:11.233122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.233707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.234204 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.234977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.235469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.235890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.425041 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:11.434178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-359c54fe-24b8-4237-8b00-72c1fb4e37c6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.212561 Aug 24 14:44:11.435126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 169/334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:11 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:12.458228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:12.459852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:12.481295 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.482466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.483859 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.485396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.486433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.487381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.864660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:12.887886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-10098524-1d09-4a03-8cb2-e51faafc1da6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.435067 Aug 24 14:44:12.902557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 166/335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:12 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:13.785746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1293352455", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "networks": [{"uuid": "227b76b1-0b7e-4dde-a5cc-fdbc91c5edcc"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:13.862620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] validate_networks() for [('227b76b1-0b7e-4dde-a5cc-fdbc91c5edcc', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:44:13.936818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:13.939082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:13.947835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:13.949184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:13.950102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:13.951178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:13.952074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:13.953033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:14.208479 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:14.225062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-906a0f76-687b-4c38-9660-3e339e214b47 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.303496 Aug 24 14:44:14.225677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 167/336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:13 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:14.413972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:44:14.414883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:44:14.416863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:44:14.417674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:44:14.418370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:44:14.435383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:14.436237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:14.436801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:14.438253 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:14.439161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:14.439914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:14.468263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Getting quotas for project 21471957737c4c42949ad067de224cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:14.473484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Getting quotas for user dc387b373c2544b3b39feb0cddfbb585 and project 21471957737c4c42949ad067de224cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:14.494148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:44:14.496972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:14.563336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cd3cd12a-0065-4dda-99a8-d2a1ca663ec6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783382 Aug 24 14:44:14.570362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 170/337] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:44:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:44:14.575955 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3fb03daf-4fa3-4a3d-afb2-c3fb29857b7e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:14.576693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3fb03daf-4fa3-4a3d-afb2-c3fb29857b7e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:14.640555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3fb03daf-4fa3-4a3d-afb2-c3fb29857b7e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:14.651369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3fb03daf-4fa3-4a3d-afb2-c3fb29857b7e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1219 microversion: 2.1 time: 0.079219 Aug 24 14:44:14.652568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 168/338] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:14 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:14.691355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48cd60-f289-4e6a-9b56-eb20f72300d4", "name": "network-vif-plugged", "status": "completed", "tag": "4f4c0736-9fd5-4c31-96be-5d2eec4f3800"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:14.703755 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:14.704302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:14.705424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:14.727642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] Creating event network-vif-plugged:4f4c0736-9fd5-4c31-96be-5d2eec4f3800 for instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 on hv-cinder-84889 Aug 24 14:44:14.738464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-00a7a295-e8f3-4368-a325-684d7bfa7155 req-56d1d554-3673-4323-a686-7ccdf9a6818f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049755 Aug 24 14:44:14.740171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 171/339] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:15.253042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:15.253851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:15.265237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.266096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.267219 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.268348 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.269250 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.269975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.455085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:15.464725 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f5e91a6d-9de7-4f65-ad80-809b04cd3652 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.216665 Aug 24 14:44:15.469063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 169/340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:15 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:15.680343 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:15.681240 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:15.692243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.692730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.693147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.694201 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.694849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.695309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.771264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:15.779791 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cafa2c42-3aff-4107-ad4d-d3d4e2bdd349 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1215 microversion: 2.1 time: 0.105802 Aug 24 14:44:15.780414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 172/341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:15 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:16.487424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:16.488194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:16.495658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.496203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.496693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.497580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.498090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.498575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.679715 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:16.691230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-665a5f0c-3b48-417a-addf-5e7d34c0502f tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1315 microversion: 2.1 time: 0.208670 Aug 24 14:44:16.691813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 170/342] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:16 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:16.808452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:16.809358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:16.816135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.816609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.817034 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.817895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.818482 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.818923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.912350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:16.926302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-383ece17-7505-4100-92ab-b61cf029368f tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1279 microversion: 2.1 time: 0.125360 Aug 24 14:44:16.926941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 173/343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:16 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:17.717735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:17.719095 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:17.729632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.730709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.731404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:17.732545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.733169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.733744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:17.924665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:17.933574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6f705019-7d01-42f7-8321-693e09573fdc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1465 microversion: 2.1 time: 0.221301 Aug 24 14:44:17.934258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 171/344] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:17 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:17.954195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:17.955268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:17.964608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.965213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.965663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:17.966351 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.966958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.967437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.006928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:18.007538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:18.016003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.017201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.017777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.018912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.019627 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.020337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.057953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:44:18.068128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:18.079725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-198f06b7-7bc5-4b60-8f69-d9c3dca23e00 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1277 microversion: 2.1 time: 0.131870 Aug 24 14:44:18.080640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 174/345] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:17 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:18.183021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a1b0764a-f4ae-4368-9102-e25085207ee6 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 204 len: 0 microversion: 2.1 time: 0.180135 Aug 24 14:44:18.184164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 172/346] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:44:18 2022] DELETE /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:44:18.200845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:18.202077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:18.213549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.214597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.215433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.216753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.217655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.218466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.539873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:18.549300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7c5a4ff6-8eba-4f69-bb81-e47bae9ac7f8 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1471 microversion: 2.1 time: 0.358523 Aug 24 14:44:18.549874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 175/347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:18 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:19.105030 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:19.106288 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:19.116580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.117258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.117696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.118491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.119264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.119994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.124899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:19.283909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:19.292262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e8475313-2015-40e7-b246-e4c51840470a tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.193902 Aug 24 14:44:19.292950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 173/348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:19 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:19.571271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:19.571991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:19.578897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.579394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.579833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.580731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.581200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.582422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.619529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:19.790461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:19.801626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e0c4406d-0086-4a4d-931c-f308b5161d37 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1471 microversion: 2.1 time: 0.233905 Aug 24 14:44:19.802750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 176/349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:19 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:20.319902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:20.323211 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:20.333569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:20.334452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:20.334988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:20.335836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:20.336362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:20.341995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:20.532817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b", "tag": "0bf7b6ff-4afa-4180-af11-7347ef74121f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:20.563494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:20.565012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:20.566092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:20.582120 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] Creating event network-changed:0bf7b6ff-4afa-4180-af11-7347ef74121f for instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b on hv-cinder-84889 Aug 24 14:44:20.594081 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-baf5bd42-c39a-4511-8a38-3931bbe4585a req-0d0b925d-743e-4033-81c2-25d22ff42f4e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064550 Aug 24 14:44:20.595642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 177/350] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:20.657006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:20.669369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-067039b8-6e55-4907-ad66-5612c0557444 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.358188 Aug 24 14:44:20.669955 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 174/351] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:20 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:20.830121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:20.831397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:20.845669 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:20.846658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:20.847403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:20.848548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:20.849197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:20.849903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.135088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48cd60-f289-4e6a-9b56-eb20f72300d4", "name": "network-vif-deleted", "tag": "4f4c0736-9fd5-4c31-96be-5d2eec4f3800"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:21.145965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:21.146930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:21.147519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.166811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:21.167172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] Creating event network-vif-deleted:4f4c0736-9fd5-4c31-96be-5d2eec4f3800 for instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 on hv-cinder-84889 Aug 24 14:44:21.174220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-e36a2ecb-cdcd-46eb-b067-3bc3a493c81b req-7a3cbef7-6aca-4ee1-b2c5-b90958834c73 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042479 Aug 24 14:44:21.176698 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 175/352] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:21.179506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b204b6d-5dc4-4ca4-9e41-9d6594b023b1 tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1471 microversion: 2.1 time: 0.354290 Aug 24 14:44:21.180446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 178/353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:20 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:21.696891 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:21.698186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:21.706986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:21.707473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:21.708058 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.708751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:21.709800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:21.710211 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.873033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:21.881971 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0c16ca4f-8ca6-4ff7-90f0-3abcb51fab7d tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.189717 Aug 24 14:44:21.882566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 176/354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:21 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:22.203007 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:22.203679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:22.210412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:22.210925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:22.211375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:22.212063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:22.212505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:22.212916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:22.253250 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:22.253827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:22.254257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:22.254728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lazy-loading 'fault' on Instance uuid 9b48cd60-f289-4e6a-9b56-eb20f72300d4 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:22.305723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0deb8f087ea448debe87c3c28a05db35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd86121e69094a149766cfd767819791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:22.313476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4fe27300-6294-4e38-b831-ea5826ae8bcc tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 200 len: 1305 microversion: 2.1 time: 0.113924 Aug 24 14:44:22.314580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 179/355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:22 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:22.907690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:22.908693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:22.918676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:22.919352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:22.920308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:22.921292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:22.922074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:22.922772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:23.099095 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:23.120724 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-67e8472a-0938-400e-a14e-c571cf00f6ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.220313 Aug 24 14:44:23.134800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 177/356] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:22 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:23.335402 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:23.336005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] [instance: 9b48cd60-f289-4e6a-9b56-eb20f72300d4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:23.343759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:23.344294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:23.344775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:23.345483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:23.346096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:23.346575 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:23.361991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] HTTP exception thrown: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Request method failure captured: Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 HTTP/1.1 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjktk30ANHtIWK-GGpbaLiZeO187RGbHoEzTSD142nYPuux58Ps3DxvfNOzvh0Tizgq2K0vYPCs2DRgT3WpqZy9ciZIkRQH2AM58WeLH1_QXjusFCd_wfdIOiwUBv1zcr937VCzIeLXHrldfUQ3Xh1Umui-7-LVitu4k1_zrurUFL-A Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: cd86121e69094a149766cfd767819791 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-1311606594 Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:44:23.363671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_cd86121e69094a149766cfd767819791", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cd86121e69094a149766cfd767819791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cd86121e69094a149766cfd767819791"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/cd86121e69094a149766cfd767819791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-1311606594 Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: cd86121e69094a149766cfd767819791 Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-1311606594 Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-1311606594-project Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 0deb8f087ea448debe87c3c28a05db35 Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-1311606594-project Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. Aug 24 14:44:23.373009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '9b48cd60-f289-4e6a-9b56-eb20f72300d4'} Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:44:23.373834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. Aug 24 14:44:23.375283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:44:23.377126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] Returning 404 to user: Instance 9b48cd60-f289-4e6a-9b56-eb20f72300d4 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:44:23.377126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ce3fe604-adf8-4fc7-a010-ba6f27f5828c tempest-VolumesNegativeTest-1311606594 tempest-VolumesNegativeTest-1311606594-project] 10.222.0.90 "GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4" status: 404 len: 111 microversion: 2.1 time: 0.033628 Aug 24 14:44:23.377126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 180/357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:23 2022] GET /compute/v2.1/servers/9b48cd60-f289-4e6a-9b56-eb20f72300d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:44:24.142431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:24.143259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:24.150786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:24.151437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:24.151708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:24.152413 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:24.152958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:24.153288 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:24.335917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:24.351621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c370b817-7919-4eba-8761-7e62203360f4 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.213402 Aug 24 14:44:24.352930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 178/358] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:24 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:25.385000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:25.386762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:25.391686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:25.392781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:25.393962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:25.403972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:25.405262 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:25.405959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:25.407186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:25.407926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:25.408606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:25.590347 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:25.598722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2b9c1a65-fd46-47be-aa39-70b67c9f744e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.227077 Aug 24 14:44:25.599457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 181/359] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:25 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:26.131335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:26.132133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:26.134418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:26.143920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.144752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.145226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.145965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.146455 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.146903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.323145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'services' on Instance uuid 9bb600b0-9df3-4758-9663-8b67de110251 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:26.467537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-671b2732-7720-4da3-963a-5e5e124a7939 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments/53805fd3-525f-46c1-8b6e-98f0c6234417" status: 202 len: 0 microversion: 2.1 time: 0.340698 Aug 24 14:44:26.468447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 179/360] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:44:26 2022] DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments/53805fd3-525f-46c1-8b6e-98f0c6234417 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:26.625723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:26.626887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:26.644165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.644956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.645723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.647711 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.648567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.649358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.796543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b", "name": "network-vif-plugged", "status": "completed", "tag": "0bf7b6ff-4afa-4180-af11-7347ef74121f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:26.809715 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:26.819989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.819989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.819989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.843512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] Creating event network-vif-plugged:0bf7b6ff-4afa-4180-af11-7347ef74121f for instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b on hv-cinder-84889 Aug 24 14:44:26.857108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-36d845a0-872b-4511-8b64-1d2c5309d9f0 req-df822d2f-ce09-4409-b811-b3176e0924e9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072561 Aug 24 14:44:26.858743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 180/361] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:26.863826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:26.873074 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c8d3629d-25ea-4d1d-ab9e-dc248961f920 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.255138 Aug 24 14:44:26.873757 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 182/362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:26 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:27.897452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:27.898206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:27.905890 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:27.906738 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:27.907361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:27.908183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:27.908640 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:27.909068 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.081066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:28.090311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2c0d9480-76ed-425d-914c-d07fbab61597 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.197927 Aug 24 14:44:28.090940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 181/363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:27 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:28.345280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:28.347551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:28.354202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.354717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.355150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.355846 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.356294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.356708 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.732767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:28.740807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.741721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.742135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.773190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Going to try to stop instance {{(pid=127296) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:44:28.835999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-56d747d7-6406-4009-a39b-f85e40fbe543 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493480 Aug 24 14:44:28.837267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 183/364] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:44:28 2022] POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:28.887747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6c2d373-9676-468e-9b2f-9115ea2d1cd3 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action" status: 202 len: 0 microversion: 2.1 time: 0.159381 Aug 24 14:44:28.888388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 182/365] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:28 2022] POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:44:28.903307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:28.904373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:28.913453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.914369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.915132 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.916161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.916552 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.917165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:29.114986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:29.115704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:29.125274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:29.125776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:29.126236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:29.126981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:29.127647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:29.128254 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:29.174394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:29.198225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-435bc2fd-c74b-4bee-9e17-0f8b96b77c28 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.301436 Aug 24 14:44:29.198962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 184/366] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:28 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:29.312694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:29.330498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-936032e9-ee5f-4872-b1be-32b9c08023ca tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1319 microversion: 2.1 time: 0.222049 Aug 24 14:44:29.332015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 183/367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:29 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:30.225171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:30.226870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:30.233529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.234394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.234953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.235762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.236324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.236865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.250087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1721358742", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1919046976", "security_groups": [{"name": "tempest-secgroup-smoke-1803742119"}], "networks": [{"uuid": "fcdc2d8c-86f4-460f-8acb-853a94cd71d3"}], "block_device_mapping_v2": [{"uuid": "bc221059-763c-410e-8c54-a8c74249b608", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:30.483144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:30.492423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-48c15aab-f0eb-4c07-a752-b6b381cf9234 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.272326 Aug 24 14:44:30.492947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 185/368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:30 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:30.498564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:30.499318 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:30.506135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.506792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.507332 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.508153 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.509502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.510005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.522914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] validate_networks() for [('fcdc2d8c-86f4-460f-8acb-853a94cd71d3', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:44:30.699313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:30.715011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c0b78b78-1c80-4197-be08-a139df5bd09b tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1508 microversion: 2.1 time: 0.220920 Aug 24 14:44:30.716454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 186/369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:30 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:30.745524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1ee116d-d167-4b2b-8c40-fe32a4adce3f", "device": "/dev/sdb"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:30.748883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:30.759428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.760201 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.760874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.761677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.762378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.763095 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.225608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e7e4de0-adf2-4da9-9c9e-06369a2a9535 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "POST /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486660 Aug 24 14:44:31.235466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 187/370] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:44:30 2022] POST /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:31.525682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:31.527090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:31.534287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.535132 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.535571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.536481 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.537108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.537683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.624076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:44:31.625649 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:44:31.626953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:44:31.627877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:44:31.628536 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:44:31.639735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.640659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.641620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.642996 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.643858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.644629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.667875 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Getting quotas for project 8c14444d5dc04d1a80d159f6ca0a64db. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:31.673887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Getting quotas for user e646bfca226747cc8c6ae44371008317 and project 8c14444d5dc04d1a80d159f6ca0a64db. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:31.687479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:31.698809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c99d2253-e1da-42ea-bee7-0eec81989893 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.177037 Aug 24 14:44:31.713996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 188/371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:31 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:31.745705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:44:31.748903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc221059-763c-410e-8c54-a8c74249b608',volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:31.894658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-059eeb40-46da-4134-a204-ba2742f37f69 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.652053 Aug 24 14:44:31.895273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 184/372] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:44:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:44:31.909286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d2cb14a-24f1-44e4-81cb-bf5195c31aba tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:31.909881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5d2cb14a-24f1-44e4-81cb-bf5195c31aba tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:32.044828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5d2cb14a-24f1-44e4-81cb-bf5195c31aba tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:32.052737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5d2cb14a-24f1-44e4-81cb-bf5195c31aba tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1089 microversion: 2.1 time: 0.148051 Aug 24 14:44:32.055416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 189/373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:31 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1089 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:32.722754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:32.723366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:32.738861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.739358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.739791 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.740511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.740971 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.741392 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.994411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:33.003195 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a1125d21-57fc-4ef4-8e9e-cb77e5f4adf4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.285080 Aug 24 14:44:33.004077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 185/374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:32 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:33.073975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:33.075351 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:33.085846 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.086433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.087011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:33.087938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.088395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.088814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:33.174474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:33.186144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1da354e7-7942-43c8-9213-6e3d32b6a036 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1187 microversion: 2.1 time: 0.115581 Aug 24 14:44:33.187142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 190/375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:33 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:34.028151 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:34.028982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:34.036943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.038411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.039196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.040442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.040984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.041469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.212833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:34.215206 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:34.216032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:34.225249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.225972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.226471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.226763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9b128d0d-c0f2-43af-ba0b-f8faf497de11 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.202254 Aug 24 14:44:34.227317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.227852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.228520 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.234040 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 186/376] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:34 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:34.358285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:34.370928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d8dea907-7615-42a2-b927-a2eb20edfeda tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1205 microversion: 2.1 time: 0.158742 Aug 24 14:44:34.373067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 191/377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:34 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1205 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:35.276898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:35.278093 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:35.287339 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.288054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.288644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.289515 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.290295 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.291043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.395608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:35.396879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:35.406412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.407368 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.407991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.409571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.410223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.410827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.446746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:35.515390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:35.544817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4ecd4ad5-8676-4e21-9ece-f1a5fbf8288b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.287821 Aug 24 14:44:35.545406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 187/378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:35 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:35.823741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:35.833029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-12234827-d480-431e-9506-c0f3c0f853e3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.444149 Aug 24 14:44:35.833851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 192/379] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:35 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:36.489875 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:36.505757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.506246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.510346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.524102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] Creating event network-changed:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:44:36.535598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-0a6450f7-9ebe-41bd-bde6-4588ccf5136a req-013c9a97-fc25-4576-8c7b-1d4879b26150 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048455 Aug 24 14:44:36.537214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 188/380] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:36.572570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:36.574458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:36.583490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.584057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.584978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.585817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.586362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.586928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.856453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:36.857325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:36.867488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.868317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.871594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.872983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.874238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.874984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.911521 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:36.920631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-58267f3b-adae-426e-8556-735e64f190a2 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.355432 Aug 24 14:44:36.921825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 193/381] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:36 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:37.047698 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:37.056115 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fa1bd26c-33e9-45c1-b03e-b44e918e5692 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.206165 Aug 24 14:44:37.056687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 189/382] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:36 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:37.891500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:37.897666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:37.932451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.937030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.937638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.940611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.941155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.943476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.949296 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:37.950397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:37.961926 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.962425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.965220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.965980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.966456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.969221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.987395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'flavor' on Instance uuid 382891eb-ee91-47fd-b81f-2d0c85e31864 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:38.304084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-566e4467-d63e-4cb7-af48-4196189ae104 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/action" status: 200 len: 32 microversion: 2.1 time: 0.417853 Aug 24 14:44:38.309396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:38.313631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:38.321718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 194/383] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:37 2022] POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/action => generated 32 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:44:38.328947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-60304686-6bea-4f3c-b5f1-6046216fc473 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.384068 Aug 24 14:44:38.335389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 190/384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:37 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:38.341594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:38.341856 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:38.343135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:38.349327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:38.353201 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.357948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.359478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.360946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.365017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.365665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.367736 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.371064 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.377335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.378338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.379032 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.379642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.646879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:38.660544 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-04bf42f3-126b-4962-b697-9faf7d8ef3ea tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.336783 Aug 24 14:44:38.663068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 195/385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:38 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:38.705088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:38.715472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f313a58c-0665-42cd-87a8-3c0ea5a0feaf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.377601 Aug 24 14:44:38.716398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 191/386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:38 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:39.370947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:39.372971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:39.385715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.386490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.387114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.388098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.388881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.389461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.687797 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:39.689590 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:39.691116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:39.700544 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bf6b9a91-0514-4892-b88a-2a2d69ba9f9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.340673 Aug 24 14:44:39.704331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.707167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.708180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.709170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.710984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.711294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 196/387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:39 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:39.728819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.743321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:39.744020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:39.757036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.761744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.761744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.761744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.762586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.763078 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.970991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:39.991175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-aad5e8fd-7cdd-4300-9a6b-31660c7aa745 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.308951 Aug 24 14:44:39.992405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 192/388] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:39 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:40.182840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:40.205875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9e52d614-46fb-486b-aa00-7d34ba4dae00 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.471528 Aug 24 14:44:40.208014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 197/389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:39 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:40.732581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:40.733286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:40.740260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:40.740737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:40.741153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:40.742018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:40.742657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:40.743065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:40.918993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:40.927780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-651b6659-ce6c-4834-a12f-af9a30803687 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.199285 Aug 24 14:44:40.928652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 193/390] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:40 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:41.012093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:41.013427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.020181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.020671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.021100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.021831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.022446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.023209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.225837 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:41.238933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:41.239727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.245083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-97b24227-a24b-4c9a-a585-6c2271bc6c6d tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.236635 Aug 24 14:44:41.258168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 198/391] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:41 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:41.260656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.261235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.261727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.262691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.263824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.264274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.462562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:41.471192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8a712ce6-2df6-48ff-b4e2-2eeb07eebb51 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.236251 Aug 24 14:44:41.484513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 194/392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:41 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:41.956301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:41.957072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.963585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.964670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.965365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.966175 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.966779 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.967298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.049588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:42.122848 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.132635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6093deca-73f6-447b-8847-369b15c61fb6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.181608 Aug 24 14:44:42.146836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 199/393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:41 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:42.283449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:42.284847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:42.287264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:42.288537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:42.297171 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.298190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.298885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.299884 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.300540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.301162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.492783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:42.493150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:42.500380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.501174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.501775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.502685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.503360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.504081 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.560881 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.576054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9b82a762-71f8-4630-a409-b0d03ce26ef9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.296642 Aug 24 14:44:42.579097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 195/394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:42 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:42.676421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.685286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-456f0475-7395-4d0b-9d39-ed357d3cc84f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.196537 Aug 24 14:44:42.685881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 200/395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:42 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:43.156490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.157112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.167505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.167898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.168802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.169259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.169667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.435390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:43.446389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8952ece4-03dd-4c50-8830-d5f097d89382 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.295080 Aug 24 14:44:43.447708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 196/396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:43.606731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.608080 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.618352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.619419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.620743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.621975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.623527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.624636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.711921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.712646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.729216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.729901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.730135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.730866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.731880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.731880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.990213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:44.006433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-04598994-0ed1-48c8-8cdb-92e80beca566 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.408724 Aug 24 14:44:44.007830 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 201/397] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:44.038852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:44.047959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6e22e70-9d57-4229-a59b-772a6f10acbf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.343777 Aug 24 14:44:44.054607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 197/398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:44.481074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:44.481781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d746ba42-5a0f-4f25-a51c-03c49d434fd7 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Action: 'create', calling method: .version_select at 0x7f8749b30dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2063152975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpyjlYMVIQgOwMNFDy36brW0KvbAcY70FihrNzPUXNhvGqNo2pWuaq+zOeXwkZmj7woHzzPg8xSxqxxj1snwP8qvZRYXVvG42mid6RevGRg4Buob+ok8Mmj6ij8kBt3xQ=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:44.482166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:44.497702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.498153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.498816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.499756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.500240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.500627 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.513381 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-d746ba42-5a0f-4f25-a51c-03c49d434fd7 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:44.520090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-d746ba42-5a0f-4f25-a51c-03c49d434fd7 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for user ac02340a58d14a91858b7741772460f6 and project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:44.548336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d746ba42-5a0f-4f25-a51c-03c49d434fd7 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280595 Aug 24 14:44:44.549309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 202/399] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:44:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:44.716223 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:44.724782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bf948b1f-0781-4b52-8a4d-ebe4a3d37dbf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1680 microversion: 2.1 time: 0.256498 Aug 24 14:44:44.725377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 198/400] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:44 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:45.060369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:45.061226 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:45.069197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.070359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.071092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.072604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.073586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.074275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.078987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:45.080905 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:45.092055 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.092771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.093589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.094781 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.095547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.096300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.310735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:45.322800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-574182b9-d386-4dc7-ba09-692e1d9cae88 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.251854 Aug 24 14:44:45.323661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 199/401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:45 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:45.345324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:45.350263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-640c4563-bd59-496f-895c-622c6a61c5d1 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1273 microversion: 2.1 time: 0.296533 Aug 24 14:44:45.351480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 203/402] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:45 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:45.765400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:45.766014 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:45.785631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.787151 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.788012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.790241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.791104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.791687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.157915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.169581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c8e63524-5b42-4044-bade-e94733210b4e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1657 microversion: 2.1 time: 0.415619 Aug 24 14:44:46.174632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 200/403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:45 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1657 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:46.192466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:46.200914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.201882 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.203858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.229079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Going to try to start instance {{(pid=127297) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:44:46.288975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0a70b2f0-fa70-4a70-bbc4-e563cbc552d7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action" status: 202 len: 0 microversion: 2.1 time: 0.100881 Aug 24 14:44:46.290378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 204/404] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:46 2022] POST /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:46.302967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:46.303977 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:46.311411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.311933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.312585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.313311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.313774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.314197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.361713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:46.362420 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:46.382612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.382840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.383273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.384164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.384780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.385634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.537420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.551131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4e13e09d-ca4a-44e8-b481-90044f025186 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.256514 Aug 24 14:44:46.551718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 201/405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:46 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:46.556833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:46.557442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:46.564200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.564866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.565479 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.565730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.566354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.566837 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.567264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.575464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-eabfe688-24b7-43ae-8a1d-a4c6d3e394c6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.224959 Aug 24 14:44:46.576487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 205/406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:46 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:46.738399 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.747061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-75579076-6bf2-4a91-af13-738bf18b2ae2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.193604 Aug 24 14:44:46.747727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 202/407] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:46 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:47.573765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:47.574328 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:47.581871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.582360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.582818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.584169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.584169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.584169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.597825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:47.598816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:47.606425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.609180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.609180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.609180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.609180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.609630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.750555 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:47.759731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f55bd806-d7b8-4bf6-88b2-c0aba451b223 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.189048 Aug 24 14:44:47.760312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 206/408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:47 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:47.773577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:47.774442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:47.781349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.782353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.782979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.784032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.784482 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.784898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.785744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:47.789502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:47.799832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-abfd27dd-9952-466f-8f27-fb2b203d2ad0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.206206 Aug 24 14:44:47.810549 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 203/409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:47 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:47.964720 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:47.975416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0949abca-3698-4d93-8ccb-d74dd274e642 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.207191 Aug 24 14:44:47.976459 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 207/410] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:47 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:48.789554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:48.790128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:48.797499 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.797986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.798410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.799144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.799592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.800004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.823070 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:48.823674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:48.830859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.831761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.832268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.833280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.833935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.834284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.955481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:48.963560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0f29efd4-7bcb-49df-ac05-773e31b7cc18 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.177815 Aug 24 14:44:48.964403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 204/411] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:48 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:48.985767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:48.994502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6588ca1f-6f76-49c2-a133-90d6de297d36 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.175397 Aug 24 14:44:48.995312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 208/412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:48 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:48.999257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:49.000003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:49.007363 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.007843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.008675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.009119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.009555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.009968 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.293180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:49.314887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0d7ca56c-055d-40fe-9fdb-1e1e06f09f94 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.322040 Aug 24 14:44:49.315852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 205/413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:48 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:49.987187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:49.987832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:49.994739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.995232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.995661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.996398 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.996858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.997274 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.016638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:50.017464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:50.024556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.025173 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.025924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.026747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.027797 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.028403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.256825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:50.259708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:50.268096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-62dbc5cb-4002-4001-860e-53a593605a6c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.285449 Aug 24 14:44:50.272833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6bc84e5c-826a-41cb-95a0-124267723f5a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.260180 Aug 24 14:44:50.275020 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 206/414] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:50 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:50.283121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 209/415] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:49 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:50.337877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:50.338916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:50.347773 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.351112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.351908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.353309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.354166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.357827 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.380335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:50.556775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:50.565389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-44074c58-8e46-4bf6-9288-450d6030f24c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.231448 Aug 24 14:44:50.566353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 207/416] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:50 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:51.293045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:51.293852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:51.300632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:51.301796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:51.302821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.303651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.304389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.305574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.306179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.306943 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.313783 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.314576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.315066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.316082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.316877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.317638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.480983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.490471 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c7ee754f-f5ca-41b5-a036-418ef2e06a06 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.197440 Aug 24 14:44:51.491108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 208/417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:51 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:51.503344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.512035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-245be7d0-ff58-490b-adf1-00680986fa13 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.223924 Aug 24 14:44:51.513283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 210/418] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:51 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:51.588915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:51.589915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:51.600015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.600784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.601475 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.602646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.603415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.604077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.779564 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.791570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d33d648c-c492-4592-ae32-6fca39364f67 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.208813 Aug 24 14:44:51.792484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 209/419] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:51 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:52.520931 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.521601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.529117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.529606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.534054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.534054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.534054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.534054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.536509 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.537525 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.545382 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.545867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.546293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.547036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.547777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.548418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.729531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:52.739333 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e26e767d-a2da-4ec0-9714-f85e464cf5a4 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.222554 Aug 24 14:44:52.739802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 211/420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:52.744563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:52.754104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-aba556e2-5cb3-4980-9856-7775d5096359 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.222566 Aug 24 14:44:52.754723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 210/421] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:52.817083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.817962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.827503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.828427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.828998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.830099 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.831017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.831530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.008908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:53.017775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-47753536-e1ea-4cbc-8c50-787337862997 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.207398 Aug 24 14:44:53.018354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 212/422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:53.761550 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:53.762483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:53.770114 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.770642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.771069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.771779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.772236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.772655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.775799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:53.776504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:53.783943 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.784560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.785136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.786010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.786476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.787287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.939551 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:53.949246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a84ebf06-aabd-4a0d-a840-381e554678a7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.191303 Aug 24 14:44:53.950272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 211/423] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:53 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:53.960662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:53.974993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0c99f799-9448-4dd9-b1a7-fbf1d80ec522 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.202680 Aug 24 14:44:53.975937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 213/424] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:53 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:54.047318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:54.048072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:54.055485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.055976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.056414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.057124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.057604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.058026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.249992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:54.264119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-14bcd328-8d32-40af-be6c-7ef6bd0b9e21 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.220445 Aug 24 14:44:54.265203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 212/425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:54 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:54.981109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:54.982169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:54.985748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:54.996064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.996911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.997656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.998948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.999845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.000559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.008835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:55.010244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:55.019574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.020101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.020667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.021563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.022544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.023169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.210001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:55.213466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:55.218775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6ab10a60-d701-4dcc-b4ee-5d623c9544ec tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1666 microversion: 2.1 time: 0.213990 Aug 24 14:44:55.219777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 213/426] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:55 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1666 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:55.227829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-69de44e5-2a6e-4a7a-92d9-52ba8a36c5f7 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.252478 Aug 24 14:44:55.228765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 214/427] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:54 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:55.294832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:55.295971 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:55.307223 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.307997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.308440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.309163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.309607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.310163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.485909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:55.494637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-13b28d0c-b3d9-4468-8452-a050c46bc7b9 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.203544 Aug 24 14:44:55.495240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 214/428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:55 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:56.246469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:56.247936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:56.252202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:56.261632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:56.262688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:56.262953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.263792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.264950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.266715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.267320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.267914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.279907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.280947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.281877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.283563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.283563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.284555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.466500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.479793 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-48ad36aa-feca-40c4-aed4-870fa94e3cb8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1670 microversion: 2.1 time: 0.242013 Aug 24 14:44:56.480564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 215/429] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:56 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:56.498616 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.507813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b180328-7b7e-49b8-8aac-3b3cd52eaee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.252622 Aug 24 14:44:56.508835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 215/430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:56 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:56.517694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:56.518506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:56.526036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.526767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.527315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.528215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.528809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.529361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.696961 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.708935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0a06a735-ff2d-46f9-80c0-166a0593729c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.195527 Aug 24 14:44:56.710018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 216/431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:56 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:57.535159 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.536876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.547278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.548106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.548854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.550001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.551377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.552090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.733861 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.736429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.747853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.748811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.749679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.750997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.751916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.752736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.762471 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.777642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-44d73c61-7218-4c0c-a414-38557f167bd9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.246248 Aug 24 14:44:57.781480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 216/432] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:57.965140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.978429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f86a8700-ced1-4e77-bfac-729b706a1212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.250361 Aug 24 14:44:57.980704 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 217/433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:58.101139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:58.101363 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:58.103196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:58.109268 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.109757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.110188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.110952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.111374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.111818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.231241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lazy-loading 'services' on Instance uuid ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:58.353481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dc8e2cbf-9c75-48dc-a52d-98bfdf0c9738 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b/os-volume_attachments/c1ee116d-d167-4b2b-8c40-fe32a4adce3f" status: 202 len: 0 microversion: 2.1 time: 0.256334 Aug 24 14:44:58.354497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 217/434] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:44:58 2022] DELETE /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b/os-volume_attachments/c1ee116d-d167-4b2b-8c40-fe32a4adce3f => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:58.812157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:58.813235 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:58.820789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.821338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.821824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.822624 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.823165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.823721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.998744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:59.011390 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3787a048-1462-4003-b60f-848d9f724bc6 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.203477 Aug 24 14:44:59.012403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 218/435] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:58 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:59.014560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:59.015796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:59.023459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.023941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.024370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.025262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.025718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.026131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.238353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:59.247301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c224c375-152b-4520-a84a-a1db22ea8331 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.238693 Aug 24 14:44:59.247808 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 218/436] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:59 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:59.496081 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "name": "network-vif-plugged", "status": "completed", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:59.511115 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.511939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.512718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.532299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] Creating event network-vif-plugged:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:44:59.539154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-cc917019-4f0f-42f5-8dfe-9e9d8c5c33f9 req-addbbe37-fc30-46cb-ac14-36ee1c027d08 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049698 Aug 24 14:44:59.539755 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 219/437] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:00.038438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:00.039489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:00.048345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.049896 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.050462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.051838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.052292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.052779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.278163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:00.278835 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:00.280079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:00.291221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.291877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.292582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.293886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.294761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.295439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.297224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f688f83a-ab15-49cc-b6d3-c547a8283a2e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1738 microversion: 2.1 time: 0.265313 Aug 24 14:45:00.298655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 219/438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:00 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:00.545374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:00.554742 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-21a20082-93e4-4dab-b78e-9d80ccf09fa0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.288578 Aug 24 14:45:00.555327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 220/439] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:00 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.325749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.326647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.336088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.336776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.337403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.338473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.339141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.339755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.543274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:01.555212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-371f50f6-cbda-4252-86cf-f51e5d39617f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1718 microversion: 2.1 time: 0.235520 Aug 24 14:45:01.555992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 220/440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:01 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1718 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.580692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.582731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.593081 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.593730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.594802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.595757 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.596396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.596987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.688228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.689233 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.700812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.701652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.702424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.703976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.704779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.705948 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.834367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:01.844353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cfac03cd-a51c-4e42-90b2-476a5a633681 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.271124 Aug 24 14:45:01.849565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 221/441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:01 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.856116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.856883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.860811 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] HTTP exception thrown: Cannot 'detach_volume' instance 382891eb-ee91-47fd-b81f-2d0c85e31864 while it is in vm_state rescued Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Request method failure captured: Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments/2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f HTTP/1.1 Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhuSgEoowesTUETXCMXkefDEzMPfYQQutwmxZaFStHtasQklb6IOHxEZSVYbxi8EHg5NJztgMcuse4M4Y2cInmWTzQ2YTi1tz8yMRq11DFVqCGWmqFNnl6MJwzSHsPEputZjZUK4FQzn94IFqyJD_MnBmY7V2f0Oz1QCuXosjRCdDU Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:45:01.864015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d39aed3397c47b7a361a0036c2f0eeb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 9cef72df53e14cc39db936f6737d842c Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:45:01.865871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Cannot 'detach_volume' instance 382891eb-ee91-47fd-b81f-2d0c85e31864 while it is in vm_state rescued Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'server_id': '382891eb-ee91-47fd-b81f-2d0c85e31864', 'id': '2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f'} Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:01.866726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 382891eb-ee91-47fd-b81f-2d0c85e31864 while it is in vm_state rescued Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 382891eb-ee91-47fd-b81f-2d0c85e31864 while it is in vm_state rescued Aug 24 14:45:01.868711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:01.870392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.870392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.870631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Returning 409 to user: Cannot 'detach_volume' instance 382891eb-ee91-47fd-b81f-2d0c85e31864 while it is in vm_state rescued {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:01.870784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.870784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.870784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.870784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.871291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5ede99c2-24e2-4c28-bcc5-ae18f6c56654 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments/2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f" status: 409 len: 152 microversion: 2.1 time: 0.186462 Aug 24 14:45:01.872341 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 221/442] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:45:01 2022] DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments/2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:45:01.886979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:01.887851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.902598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.904061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.906926 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.908685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.909870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.910929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.917138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:01.983141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:02.009302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:02.018182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-46f8c16b-f206-4448-9415-97755e9ca319 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/action" status: 202 len: 0 microversion: 2.1 time: 0.137306 Aug 24 14:45:02.019179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 222/443] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:45:01 2022] POST /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:45:02.030172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.031022 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.041500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.042338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.043128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.044367 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.045179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.045957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.054705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a90ec9f7-d338-44ad-b926-d7f4b53a73dc tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 204 len: 0 microversion: 2.1 time: 0.203533 Aug 24 14:45:02.055308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 222/444] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:45:01 2022] DELETE /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:02.070741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.071931 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.081186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.081821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.082268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.083005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.083650 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.084352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.245177 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:02.260598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-74d5acfe-adfb-4692-b69e-5b969ebd6899 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.234386 Aug 24 14:45:02.262238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 223/445] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:02.297776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:02.310627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e10e734c-d5d1-4368-8d49-c70392a2bb09 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1514 microversion: 2.1 time: 0.248262 Aug 24 14:45:02.311686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 223/446] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:02.867495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.868346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.875316 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.876000 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.876475 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.877192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.877747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.878931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.062720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:03.074369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3119fe44-1edd-46d0-8112-623c326ceb9f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.210621 Aug 24 14:45:03.075210 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 224/447] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:03.285323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:03.286324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:03.297534 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.298377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.299347 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.300599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.301420 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.302220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.341407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:03.342387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:03.352229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.353019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.353702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.354900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.355631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.356181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.527976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:03.529907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:03.537653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bef64ce2-d2a5-4a08-bb7e-96b836151f25 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1514 microversion: 2.1 time: 0.203066 Aug 24 14:45:03.549264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0f2f0458-a3fd-4d6a-aa5f-ea6150b8199d tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.265426 Aug 24 14:45:03.549264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 224/448] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:03 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:03.550926 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 225/449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:03 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:04.103654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:04.104666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:04.114808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.115301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.115733 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.116753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.117240 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.117903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.283625 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:04.295442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-374cd67e-e381-4a2b-9b83-84acce90b39e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1261 microversion: 2.1 time: 0.197680 Aug 24 14:45:04.297298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 225/450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:04 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:04.564498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:04.565622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:04.576146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.576916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.577636 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.578754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.579469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.580136 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.581195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:04.581963 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:04.591484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.592337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.593300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.594578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.595354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.596078 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.753948 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:04.763730 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dc4064f0-c555-4a2f-9260-2eac4733e238 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1514 microversion: 2.1 time: 0.206363 Aug 24 14:45:04.764325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 226/451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:04 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:04.795833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:04.810555 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4aedebc1-d757-4df9-90b7-dcf19eff0e94 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.235623 Aug 24 14:45:04.811583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 226/452] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:04 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:05.327504 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.328422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.337289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.337910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.338921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.339943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.341114 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.341687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.597255 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:05.606606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6586465a-cbd8-4318-b18a-2fdafecd7fa7 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1445 microversion: 2.1 time: 0.284429 Aug 24 14:45:05.608061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 227/453] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1445 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:05.632385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.633699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.645113 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.645540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.646352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.647419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.648023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.648520 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.796996 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.798017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.806795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.807845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.808619 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.809928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.810949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.811814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.935983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:05.949040 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-99b76332-b027-4ae8-857c-0ae15c0e6679 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1445 microversion: 2.1 time: 0.324165 Aug 24 14:45:05.950022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 227/454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1445 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:05.958765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.959894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.970364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.970908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.971337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.972298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.972820 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.974127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.173430 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:06.187999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0f39d231-021e-4e79-8613-9ceb71f46498 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.236374 Aug 24 14:45:06.188976 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 228/455] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:06.402269 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b", "name": "network-vif-deleted", "tag": "0bf7b6ff-4afa-4180-af11-7347ef74121f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:06.411021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:06.413385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:06.413863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:06.414289 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.422045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bea35832-914f-42d7-a852-ec41b6a58de1 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1514 microversion: 2.1 time: 0.628985 Aug 24 14:45:06.422922 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 228/456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1514 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:06.428356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] Creating event network-vif-deleted:0bf7b6ff-4afa-4180-af11-7347ef74121f for instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b on hv-cinder-84889 Aug 24 14:45:06.436996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-e0747272-c7ec-4c53-9540-7b9922f99b58 req-aebaf091-593d-4f1d-8260-95171c802446 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040635 Aug 24 14:45:06.437607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 229/457] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:07.209449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:07.210205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:07.217102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.217594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.218090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.218835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.219287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.219702 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.398055 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:07.407247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2c40fd39-4f00-4007-808c-8fc7572e620e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.201612 Aug 24 14:45:07.407826 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 229/458] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:07 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:07.458290 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:07.459188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:07.468771 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.469521 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.470197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.471345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.472303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.472990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.591930 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:07.603186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9fec5ec-ea3e-4232-9618-c65768ea8c42 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1472 microversion: 2.1 time: 0.149828 Aug 24 14:45:07.604218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 230/459] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:07 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:08.183080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:08.199172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.199997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.200480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.216034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] Creating event network-changed:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:45:08.223012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-003a8d69-2d57-4c00-9685-722c4a6a9404 req-cb286e14-e93f-4e01-be33-edc984567e29 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044379 Aug 24 14:45:08.223939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 230/460] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:08.437383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:08.447142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:08.455640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.456832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.458049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.459697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.460702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.461455 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.630709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:08.632504 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:08.644410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.645336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.646154 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.647717 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.648607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.649596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.670281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:08.682171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b9cf6a36-e697-4455-bc70-bf65831516a0 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1726 microversion: 2.1 time: 0.252562 Aug 24 14:45:08.694736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 231/461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:08 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:08.714470 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.715337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.716133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.716897 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lazy-loading 'fault' on Instance uuid ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:08.774755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc387b373c2544b3b39feb0cddfbb585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21471957737c4c42949ad067de224cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:08.789104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c527d7b4-2289-4c10-885f-82c54c5a074e tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 200 len: 1309 microversion: 2.1 time: 0.165285 Aug 24 14:45:08.795572 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 231/462] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:08 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:09.691501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1910275167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2063152975", "security_groups": [{"name": "tempest-secgroup-smoke-204705932"}], "block_device_mapping_v2": [{"uuid": "2b314dfe-107e-4191-8de1-572ca60098fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29258503-d20d-4638-a36b-45ed3774b302"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:09.708980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:09.710090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:09.719871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.720436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.720942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:09.721704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.722240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.722843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:09.868030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] validate_networks() for [('29258503-d20d-4638-a36b-45ed3774b302', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:45:09.958080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:09.970107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-75b416e6-e0f9-41f7-89d0-340811682ed8 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1732 microversion: 2.1 time: 0.266066 Aug 24 14:45:09.974132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 232/463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:09 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1732 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:09.981303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:09.982720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] [instance: ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:09.989889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.990763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.991446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:09.992592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.993279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.993772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.011438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] HTTP exception thrown: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Request method failure captured: Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b HTTP/1.1 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjjRofxyvP2xiBlJ2dsiY3j8motgKmxUlZXmqf7YIOyvGK19dLVnBMnaL1ALg9EyQBnkUnfklgrEIkxDRwgnr-llu3fJvpfudcV4ufqA8PWO8idsQRsoOcfogNyHCoIex9coj-orVJ-j7hIxXzTs3J_FIJmDwLVj4a-Q-D2Jnypj8wM Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 21471957737c4c42949ad067de224cf8 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:45:10.013574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21471957737c4c42949ad067de224cf8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21471957737c4c42949ad067de224cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21471957737c4c42949ad067de224cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21471957737c4c42949ad067de224cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 21471957737c4c42949ad067de224cf8 Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2057422698 Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesSnapshotTestJSON-2057422698-project Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: dc387b373c2544b3b39feb0cddfbb585 Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesSnapshotTestJSON-2057422698-project Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. Aug 24 14:45:10.015485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b'} Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:10.017285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. Aug 24 14:45:10.019866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:45:10.022462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] Returning 404 to user: Instance ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:10.022462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9fc7f618-60a4-4466-9be4-8380939170a6 tempest-VolumesSnapshotTestJSON-2057422698 tempest-VolumesSnapshotTestJSON-2057422698-project] 10.222.0.90 "GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b" status: 404 len: 111 microversion: 2.1 time: 0.039314 Aug 24 14:45:10.022462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 233/464] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:09 2022] GET /compute/v2.1/servers/ffc9f40d-6cff-4471-ad9c-8b20e1a11a6b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:45:10.024578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:10.025193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:10.032157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.032907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.033409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.034218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.043304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.044448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.197914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-379ffb17-0119-486d-938d-2a186c7765ab tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177961 Aug 24 14:45:10.199481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 234/465] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:45:10 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:10.769718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:45:10.770622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:45:10.771104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:45:10.771634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:45:10.772162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:45:10.783580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.784073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.784505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.785226 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.785673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.786093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.807302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:45:10.815210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for user ac02340a58d14a91858b7741772460f6 and project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:45:10.904666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:45:10.909195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b314dfe-107e-4191-8de1-572ca60098fc',volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:45:11.076173 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1ffd1c67-ee03-4e18-ad51-4297b7d4611b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.390933 Aug 24 14:45:11.077628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 232/466] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:45:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:45:11.095558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d75233eb-c1a1-48f7-a602-0b4626211e8c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:11.096706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d75233eb-c1a1-48f7-a602-0b4626211e8c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:11.174910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d75233eb-c1a1-48f7-a602-0b4626211e8c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:11.188165 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d75233eb-c1a1-48f7-a602-0b4626211e8c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1095 microversion: 2.1 time: 0.099007 Aug 24 14:45:11.189990 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 235/467] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:11 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:11.643784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:11.659429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:11.662959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:11.664713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:11.681370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] Creating event network-changed:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:45:11.689948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6e4e3d44-955b-41cf-a775-2a4155b2ac62 req-0c732baf-0a99-401c-8ea4-d5e39b8e28f6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057175 Aug 24 14:45:11.691288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 233/468] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:12.224082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:12.224821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:12.232583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:12.233073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:12.233563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:12.234261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:12.234743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:12.235156 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:12.313812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:12.321972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1361e668-1971-4708-b231-4608332f23b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1193 microversion: 2.1 time: 0.101940 Aug 24 14:45:12.322677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 236/469] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:12 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:13.344940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:13.345617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:13.352783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:13.353288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:13.353718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:13.354394 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:13.354880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:13.355327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:13.421133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:13.429332 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5d94172f-aaee-4a59-8be7-c43d6cf49c3e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1193 microversion: 2.1 time: 0.088649 Aug 24 14:45:13.429884 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 234/470] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:13 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:13.710064 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:13.721419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:13.722257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:13.723015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:13.737682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] Creating event network-changed:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:45:13.742985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-04bdc147-0ac5-47e5-9f1a-c0369ee7fe2f req-42913302-08dc-48fc-869b-e458de16f232 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036526 Aug 24 14:45:13.743579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 237/471] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:14.454395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:14.455503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:14.465209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.466038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.466531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:14.467619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.468303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.468744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:14.548314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:14.556955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0ea3e4af-da65-4ada-82b1-efe8e3882c8a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1193 microversion: 2.1 time: 0.108947 Aug 24 14:45:14.557679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 235/472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:14 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:15.579013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:15.579800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:15.589262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:15.589741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:15.590400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:15.591121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:15.591574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:15.591985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:15.673752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:15.683332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c6705fed-9a23-4bc2-bab2-756c80f27281 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1211 microversion: 2.1 time: 0.108881 Aug 24 14:45:15.690282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 238/473] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:15 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:16.709888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:16.710823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:16.718131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:16.718697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:16.719332 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:16.720051 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:16.720508 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:16.720980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:16.937271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:16.954359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b31aaa93-ab21-4429-a332-6ec600fa29a9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.249017 Aug 24 14:45:16.954991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 236/474] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:16 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:17.022876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7baf2ec3-7427-4668-8143-7f2e344315ac", "tag": "5c374eaa-7c49-4edb-99d7-01abb44bdcd3"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:17.034437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.034947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.035369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.048229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] Creating event network-changed:5c374eaa-7c49-4edb-99d7-01abb44bdcd3 for instance 7baf2ec3-7427-4668-8143-7f2e344315ac on hv-cinder-84889 Aug 24 14:45:17.053387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-c25a9332-4aff-4568-9fc0-83e9c91ca7b2 req-61fede1b-ae95-4dac-8e42-ac8405dce59a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037693 Aug 24 14:45:17.053934 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 239/475] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:17.985725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:17.986774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:17.997196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.997719 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.998155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.999016 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.999463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.999885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:18.291428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:18.303155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9e12888f-b6f4-4e97-8f45-22e177774865 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.323869 Aug 24 14:45:18.304634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 237/476] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:17 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:19.329523 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:19.330407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:19.337285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:19.337753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:19.338180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:19.338916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:19.339366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:19.339787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:19.491562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:19.500279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-46377b7e-ea39-47d4-8357-2854558b7ea0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.175628 Aug 24 14:45:19.500857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 240/477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:19 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:20.520874 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:20.521452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:20.530294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.531170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.531889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.532938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.533616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.534237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.697992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:20.709134 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dea9c13b-0ab3-48bd-99cd-64a7bff7958c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.192085 Aug 24 14:45:20.709725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 238/478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:20 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:21.732436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:21.733565 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:21.737933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:21.746242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.747120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.747832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.749073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.749690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.750253 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.910073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:21.918902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-82c6d8bc-9656-4ba6-9019-74ccfe6a5d69 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.192653 Aug 24 14:45:21.919488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 241/479] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:21 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:22.950889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:22.951823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:22.953681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:22.954369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:22.962612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.963223 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.963745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:22.964644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.965296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.965803 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:23.110414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:23.118810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-eebb63e3-6e3d-4427-8f33-087418960b99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.178339 Aug 24 14:45:23.119386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 239/480] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:22 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:24.140002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:24.140588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:24.147476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:24.148034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:24.148464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:24.149160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:24.149603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:24.150016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:24.312004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:24.315603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:24.320579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-164751e7-7ba7-439d-aa2f-fbda360ba480 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.184765 Aug 24 14:45:24.321169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 242/481] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:24 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:25.341853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:25.342604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:25.351321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:25.351886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:25.352426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:25.353809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:25.354756 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:25.355487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:25.520361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:25.529818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2f3a3d49-dc74-4aed-a7f9-780fec33e72e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.191640 Aug 24 14:45:25.530687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 240/482] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:25 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:26.555473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:26.557116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:26.570908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.571747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.572456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.573713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.574557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.575128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.733919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:26.742077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bae62c04-7a1c-4566-8043-1529fe25359b tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.193921 Aug 24 14:45:26.742721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 243/483] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:26 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:27.630342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7baf2ec3-7427-4668-8143-7f2e344315ac", "name": "network-vif-plugged", "status": "completed", "tag": "5c374eaa-7c49-4edb-99d7-01abb44bdcd3"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:27.636945 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:27.643083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.643578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.643978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.657185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] Creating event network-vif-plugged:5c374eaa-7c49-4edb-99d7-01abb44bdcd3 for instance 7baf2ec3-7427-4668-8143-7f2e344315ac on hv-cinder-84889 Aug 24 14:45:27.662683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-b3d40c60-0cc1-4ffc-8ee8-6d86adaa85ec req-41849039-9652-498b-82d8-423133be3655 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036047 Aug 24 14:45:27.663646 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 241/484] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:27.763466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:27.764527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:27.772117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.772596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.773025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.773720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.774171 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.774618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:28.149085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:28.159680 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-178b06bb-5a62-43b9-8ffb-a695bf8ccd4c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.400341 Aug 24 14:45:28.160275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 244/485] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:27 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:29.183359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:29.184073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:29.190993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.191519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.191994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.192786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.193273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.193768 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.198939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:29.372872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:29.381142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-762e96c4-61ba-4d66-8c9c-3efd60f01bba tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1266 microversion: 2.1 time: 0.202665 Aug 24 14:45:29.381721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 242/486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:29 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:30.402491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:30.403240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:30.405524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=60 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:30.411081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.411566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.412014 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.412739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.413189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.413605 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.555641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:30.565201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-45501bff-afdf-4858-bc4d-a370e65d8b7c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1454 microversion: 2.1 time: 0.166826 Aug 24 14:45:30.565783 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 245/487] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:30 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:30.591309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:30.592326 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:30.602392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.602912 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.603337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.604029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.604468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.604884 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.759750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:30.770758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-59612939-8294-46aa-92fd-35d24a8fb6d0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1454 microversion: 2.1 time: 0.186091 Aug 24 14:45:30.772774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 243/488] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:30 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:32.796562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7baf2ec3-7427-4668-8143-7f2e344315ac", "tag": "5c374eaa-7c49-4edb-99d7-01abb44bdcd3"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:32.807551 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.808033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.808459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.820995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] Creating event network-changed:5c374eaa-7c49-4edb-99d7-01abb44bdcd3 for instance 7baf2ec3-7427-4668-8143-7f2e344315ac on hv-cinder-84889 Aug 24 14:45:32.828526 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-29854804-3324-470b-b302-5659e0b58a7c req-dac6b089-ab66-4de3-b7ea-809c7a03ef58 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Aug 24 14:45:32.829680 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 246/489] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:55.773868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:55.781226 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:55.783526 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=5 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.784174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=10 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.790498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.791037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.791439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.792127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.792572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.792980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.826137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-273d81de-1d35-467b-a581-1a7460d592ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056351 Aug 24 14:45:55.826889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 244/490] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:45:55 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:45:55.901857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.904301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=20 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.913682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:55.914325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:55.923295 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.925301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.925301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.927825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.927825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.927825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.968031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:56.067443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7bc7db6c-c04d-49a7-91da-6eb45cd71024 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 204 len: 0 microversion: 2.1 time: 0.169151 Aug 24 14:45:56.068182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 247/491] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:45:55 2022] DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:56.081275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:56.081275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:56.086908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.087399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.088795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.089285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.089743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.090177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.509461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:56.520036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a0efba6-bcf2-4701-831b-9fcbc82d4a35 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1676 microversion: 2.1 time: 0.444780 Aug 24 14:45:56.520717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 245/492] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:56 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1676 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:57.550128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:57.551172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:57.558830 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.559437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.560112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.561037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.561483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.562070 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.079243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:58.092024 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8e6a0a39-8381-4603-9fb3-a712100a3c01 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1676 microversion: 2.1 time: 0.546362 Aug 24 14:45:58.093200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 248/493] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:57 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1676 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:59.120032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:59.120774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:59.128058 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.128574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.129055 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.129831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.130492 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.130795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.363784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:59.378131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-37eaa1d1-39fc-4a4c-931f-3e2208a063ce tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1676 microversion: 2.1 time: 0.263695 Aug 24 14:45:59.379278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 246/494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:59 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:00.411807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:00.413963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:00.450411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.451059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.451650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:00.452364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.452822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.453257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:00.594204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:00.608809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-76267be8-b67f-4feb-92d6-9e99732de73b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1608 microversion: 2.1 time: 0.206028 Aug 24 14:46:00.609848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 249/495] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:00 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1608 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:00.805077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb600b0-9df3-4758-9663-8b67de110251", "name": "network-vif-deleted", "tag": "5fa591d5-5e29-4df7-9d1d-592f00c2f14c"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:00.851655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.852138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.854067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:00.867644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] Creating event network-vif-deleted:5fa591d5-5e29-4df7-9d1d-592f00c2f14c for instance 9bb600b0-9df3-4758-9663-8b67de110251 on hv-cinder-84889 Aug 24 14:46:00.874348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-56af7691-ceec-4082-ba4e-c6bea9e22fe3 req-3acc03f8-fd3e-4d3a-aede-cb2b0997e02e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076105 Aug 24 14:46:00.875705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 247/496] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:01.632875 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:01.633709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:01.644054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:01.647435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:01.652018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:01.653458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:01.654275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:01.664488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:01.771422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:01.772657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:01.774126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:01.775267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'fault' on Instance uuid 9bb600b0-9df3-4758-9663-8b67de110251 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:01.863692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:01.879639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e7f92350-d9c7-44ea-80b2-12cfa2d9f301 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 200 len: 1328 microversion: 2.1 time: 0.251305 Aug 24 14:46:01.896820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 250/497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:01 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:02.752086 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:02.753398 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:02.761033 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.765500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.766428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.769014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.776983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.777750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.910169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:02.910866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:02.933917 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.934417 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.934900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.959886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.965900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.969204 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'services' on Instance uuid 382891eb-ee91-47fd-b81f-2d0c85e31864 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:02.971880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.016544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 HTTP/1.1 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:46:03.018818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:46:03.020252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '9bb600b0-9df3-4758-9663-8b67de110251'} Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:03.021044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:46:03.022308 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:03.026857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:03.028216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-88bf7f03-fb61-4dc1-b1a9-c25edc1ceff0 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 404 len: 111 microversion: 2.1 time: 0.123263 Aug 24 14:46:03.036676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 251/498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:02 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:46:03.055002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6aed8832-7b83-441f-8a3b-71e9c7b07a92 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '.version_select at 0x7f8749a470d0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:03.112220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6aed8832-7b83-441f-8a3b-71e9c7b07a92 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519180671" status: 202 len: 0 microversion: 2.1 time: 0.073976 Aug 24 14:46:03.118365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 252/499] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519180671 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:46:03.187691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e3acff27-713a-4279-9779-626df7ba74fb tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments/2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f" status: 202 len: 0 microversion: 2.1 time: 0.440300 Aug 24 14:46:03.188291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 248/500] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:46:02 2022] DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments/2a0a32d9-450b-41aa-b4d6-5fdab3fb8a5f => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:46:03.197407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:03.199991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:03.235319 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.241065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.242251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.255484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.261454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.262147 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.359958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fef0a9b8-b0da-452e-8c20-f3d8d1d1a718 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163244 Aug 24 14:46:03.369227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 253/501] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:46:03 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:04.376465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:04.378989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:04.382476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f4409d24-48d3-4ec2-b1cb-683946aeea94 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: .version_select at 0x7f8749c22e50>, body: {"keypair": {"name": "tempest-keypair-1858365123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiBOBIH9zgPCRj9Po+jkXCxfQZMNF+TNbQ4NWJPMXAAJ3bKlrBQkxJF8ABL3L2rtIEO5KOdVdKQAatVty9HtpOV0MhR0ZfIQbFqb+FigrT+88BCWiYrdC4mfgPYRKYAqQ=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:04.386959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.387457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.387978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.388953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.389437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.389871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.411283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-f4409d24-48d3-4ec2-b1cb-683946aeea94 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:04.418283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-f4409d24-48d3-4ec2-b1cb-683946aeea94 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for user 1623364d853c42a88a7172adfa07ef89 and project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:04.436389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f97cef81-cc4b-4b46-80f9-6b88386ccac2 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064961 Aug 24 14:46:04.437656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 249/502] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:46:04 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:04.462334 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f4409d24-48d3-4ec2-b1cb-683946aeea94 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087364 Aug 24 14:46:04.463380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 254/503] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:46:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:05.461638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:05.465157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:05.477204 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.478309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.490631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.491869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.492549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.493165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.532714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7a60298e-4f6e-43e5-bbaf-a4e5f7c1073e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084884 Aug 24 14:46:05.533439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 250/504] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:46:05 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:46:05.636657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:05.637909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:05.648329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.649148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.649766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.651433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.652183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.652808 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.690655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:05.796665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f1bc7637-eedc-4225-8b0e-0f9ebd0dbbe3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 204 len: 0 microversion: 2.1 time: 0.164888 Aug 24 14:46:05.802430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 255/505] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:05 2022] DELETE /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:46:05.807684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:05.808314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:05.824698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.825201 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.825648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.826449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.826947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.827479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:06.195447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:06.211898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-06c5e4ca-8461-4026-85c6-f4063915dce3 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1692 microversion: 2.1 time: 0.408683 Aug 24 14:46:06.214447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 251/506] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:05 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1692 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:06.719948 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1797461550", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee8165f2-1bc8-45c6-8269-1a2c05131ca9"}], "security_groups": [{"name": "tempest-securitygroup--1755262687"}], "key_name": "tempest-keypair-1858365123", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:06.897200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] validate_networks() for [('ee8165f2-1bc8-45c6-8269-1a2c05131ca9', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:07.247277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:07.249353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:07.271259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.272718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.273412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.274714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.277589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.281183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.630373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.643265 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7c79626e-f5b9-4710-b649-f3cd416e2bc5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1692 microversion: 2.1 time: 0.401533 Aug 24 14:46:07.644391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 252/507] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:07 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1692 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:07.707175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:07.708967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:07.709454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:07.710019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:07.710614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:07.722646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.724050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.724393 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.725389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.725847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.726262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.806613 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:07.831473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Getting quotas for user 1623364d853c42a88a7172adfa07ef89 and project e0a3af4911cf4cdf99ee22cba5e82e57. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:07.882424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:07.889758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:08.027015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-50420049-475b-4e2a-8a9c-5cbee5d107e6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.313336 Aug 24 14:46:08.028906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 256/508] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:46:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:46:08.042350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-410540b1-b584-4a0b-a6c1-43c0f9325112 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:08.043351 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-410540b1-b584-4a0b-a6c1-43c0f9325112 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:08.202449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-410540b1-b584-4a0b-a6c1-43c0f9325112 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:08.214318 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-410540b1-b584-4a0b-a6c1-43c0f9325112 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1238 microversion: 2.1 time: 0.178027 Aug 24 14:46:08.221573 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 253/509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:08 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1238 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:08.667433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:08.668063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:08.679039 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.681283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.682213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.685687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.691078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.692026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.010642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:09.022923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-49bab7b2-f690-4d92-8fc4-7bdcf7c9373e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1692 microversion: 2.1 time: 0.360877 Aug 24 14:46:09.026787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 257/510] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:08 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1692 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:09.259745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:09.261137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:09.271885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.276294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.277077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.279800 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.280593 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.281298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.415068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:09.426302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-109ab3cc-d6b8-470b-9c58-c95fdd9ceeb7 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1242 microversion: 2.1 time: 0.186966 Aug 24 14:46:09.427929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 254/511] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:09 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:10.052657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:10.054983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:10.067229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.068080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.069358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.073164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.074563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.078545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.420410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:10.431326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-811c7685-fa20-4a33-8530-a207ff4654dd tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1692 microversion: 2.1 time: 0.385060 Aug 24 14:46:10.432420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 258/512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:10 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1692 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:10.457399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:10.457399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:10.475517 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.479316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.482686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.485606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.486090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.486583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.574118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:10.588379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bfd65259-f751-41cc-9ee1-f2519e2317cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1234 microversion: 2.1 time: 0.139608 Aug 24 14:46:10.592349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 255/513] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:10 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1234 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:11.460183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:11.460963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:11.469899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.471169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.471169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.472538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.472538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.472871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.625967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:11.626781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:11.639373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.640176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.641294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.642805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.643808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.644562 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.747848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:11.761933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-27a3e713-1fc7-4d1e-bd3b-18193077a269 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1692 microversion: 2.1 time: 0.311300 Aug 24 14:46:11.763033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 259/514] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:11 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:11.776696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:11.792845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-823d2fc2-4d8e-4c63-ad2e-4026bc1d36aa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1296 microversion: 2.1 time: 0.179284 Aug 24 14:46:11.806228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 256/515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:11 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:12.652368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382891eb-ee91-47fd-b81f-2d0c85e31864", "name": "network-vif-deleted", "tag": "6daec4ca-ab54-4e21-a4d0-353aa9c23245"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:12.669099 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.670609 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.671360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.690329 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] Creating event network-vif-deleted:6daec4ca-ab54-4e21-a4d0-353aa9c23245 for instance 382891eb-ee91-47fd-b81f-2d0c85e31864 on hv-cinder-84889 Aug 24 14:46:12.713611 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-7b747c4b-9d9a-4997-9037-f42469f29d86 req-6c36b991-c34e-4452-8026-a19842e0c9a7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372829 Aug 24 14:46:12.715193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 260/516] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:12.789018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:12.791216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:12.819857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:12.823664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:12.829542 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.838550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.839710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.841166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.843344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.845016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.846159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.849657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.850481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.853431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.854403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.855209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.005376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:13.008905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:13.009851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.013457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'fault' on Instance uuid 382891eb-ee91-47fd-b81f-2d0c85e31864 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:13.139743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:13.155469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6d125b8c-4ecc-4ac9-8207-20569e4294a9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 200 len: 1336 microversion: 2.1 time: 0.374533 Aug 24 14:46:13.158748 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 257/517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:12 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 1336 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:13.342975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:13.361078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b8dd50f4-fee4-4078-bebe-82b3811c3192 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.549116 Aug 24 14:46:13.365116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 261/518] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:12 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:14.177390 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:14.178227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 382891eb-ee91-47fd-b81f-2d0c85e31864] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:14.186901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:14.187385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:14.187822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:14.188523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:14.189317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:14.189498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:14.289873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] HTTP exception thrown: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Request method failure captured: Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 HTTP/1.1 Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhuSgEoowesTUETXCMXkefDEzMPfYQQutwmxZaFStHtasQklb6IOHxEZSVYbxi8EHg5NJztgMcuse4M4Y2cInmWTzQ2YTi1tz8yMRq11DFVqCGWmqFNnl6MJwzSHsPEputZjZUK4FQzn94IFqyJD_MnBmY7V2f0Oz1QCuXosjRCdDU Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:46:14.298967 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d39aed3397c47b7a361a0036c2f0eeb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 9cef72df53e14cc39db936f6737d842c Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. Aug 24 14:46:14.300475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '382891eb-ee91-47fd-b81f-2d0c85e31864'} Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:14.301215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. Aug 24 14:46:14.302688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:46:14.305000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Returning 404 to user: Instance 382891eb-ee91-47fd-b81f-2d0c85e31864 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:14.311802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95aaa935-4122-4d3b-b0f4-70a644506b3c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864" status: 404 len: 111 microversion: 2.1 time: 0.136738 Aug 24 14:46:14.314912 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 258/519] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:14 2022] GET /compute/v2.1/servers/382891eb-ee91-47fd-b81f-2d0c85e31864 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:14.355365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-42359cbd-2529-4366-a101-99d633ad2ee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '.version_select at 0x7f8749b9c700>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:14.380900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-42359cbd-2529-4366-a101-99d633ad2ee9 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657957897" status: 202 len: 0 microversion: 2.1 time: 0.044205 Aug 24 14:46:14.389529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 262/520] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657957897 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:46:14.399304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:14.409181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:14.432153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:14.433067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:14.441246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:14.443886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:14.445077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:14.446102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:14.538710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757a173f-507c-4199-a601-85202e5a39b2", "tag": "165edf10-f1f8-4b1d-ba94-b350f4f46a1b"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:14.589969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:14.590461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:14.590913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:14.616594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] Creating event network-changed:165edf10-f1f8-4b1d-ba94-b350f4f46a1b for instance 757a173f-507c-4199-a601-85202e5a39b2 on hv-cinder-84889 Aug 24 14:46:14.630303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-7f8da9e6-1b04-4b66-aae3-09b9aed38210 req-0096942e-3680-44d2-818e-c62650040392 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264606 Aug 24 14:46:14.631828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 259/521] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:15.053248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:15.067085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a4456882-cfd0-4a0f-bfae-6442dafb6746 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.672065 Aug 24 14:46:15.067600 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 263/522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:14 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:16.100488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:16.101301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:16.109737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.110615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.111280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.112516 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.113276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.114088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.425515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:16.439621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-538e75bc-7d8c-4120-ba67-60885dfcf075 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.347779 Aug 24 14:46:16.441849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 260/523] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:16 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:17.467676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:17.469111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:17.477107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:17.478256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:17.478990 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:17.479933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:17.480614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:17.484265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:17.677395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:17.682359 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:17.688923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7e3bad36-ba57-43af-8e34-ba578813f9ed tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.225664 Aug 24 14:46:17.689591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 264/524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:17 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:17.997880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:17.999232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:18.010192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.011183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.011953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.012892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.013891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.014583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.047128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:18.078945 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:18.161662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4da9d06a-b52b-453d-8d5b-802ae98665b5 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 204 len: 0 microversion: 2.1 time: 0.167440 Aug 24 14:46:18.162773 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 261/525] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:17 2022] DELETE /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:46:18.172138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:18.173054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:18.175229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:18.176137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=10 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:18.185995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.189641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.190723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.192089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.192783 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.193430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.389129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:18.402128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f5ad4562-1acb-4fc8-bc77-da5643315eae tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1507 microversion: 2.1 time: 0.233934 Aug 24 14:46:18.402946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 265/526] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:18 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:18.712230 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:18.713862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:18.717886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:18.724109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.725174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.727072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.728457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.733015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.734082 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.953715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:18.962844 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e1c0330-01a0-4aa0-bdd8-c1acccac95c6 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.256959 Aug 24 14:46:18.963737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 262/527] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:18 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:19.424711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:19.425965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:19.433259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:19.433864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:19.434303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:19.435168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:19.435626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:19.436052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:19.629892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:19.643857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4210943b-ce29-4e91-ab35-d20afa76e10a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1507 microversion: 2.1 time: 0.222672 Aug 24 14:46:19.644822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 266/528] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:19 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:19.989635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:19.990480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:20.003935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.004518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.005026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.005821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.006355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.006798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.084545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757a173f-507c-4199-a601-85202e5a39b2", "name": "network-vif-plugged", "status": "completed", "tag": "165edf10-f1f8-4b1d-ba94-b350f4f46a1b"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:20.098192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.098713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.099140 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.113603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] Creating event network-vif-plugged:165edf10-f1f8-4b1d-ba94-b350f4f46a1b for instance 757a173f-507c-4199-a601-85202e5a39b2 on hv-cinder-84889 Aug 24 14:46:20.125189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-1d3c61ab-1f03-4d5e-9a97-b704b6b41437 req-23098008-1904-44cf-82fe-35a276b762ee service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052015 Aug 24 14:46:20.127087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 267/529] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:20.260594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:20.270078 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ca0b6ef7-ce73-47d1-b55b-2a56d46abf2f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.286085 Aug 24 14:46:20.271026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 263/530] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:19 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:20.671549 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:20.672385 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:20.689208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.690123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.691086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.692789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.693707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.698814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.915652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:20.930780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ca4bf97c-bbce-4bc3-8603-9e2628f1ad8c tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1507 microversion: 2.1 time: 0.264122 Aug 24 14:46:20.945951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 268/531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:20 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:21.291829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:21.293118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:21.313468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.314307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.315094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.316276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.317107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.318030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.574623 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:21.593792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-544936cb-a749-4597-ab5c-fe7db2807513 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.305691 Aug 24 14:46:21.594716 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 264/532] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:21 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:21.953967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:21.954615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:21.962594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.963096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.963539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.964258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.964714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.965146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.997707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f436c21c-2168-42dc-940a-75b7e9319477", "name": "network-vif-deleted", "tag": "63ac2d0a-da4f-44c4-befa-11e028960fed"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:22.021335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:22.021890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:22.022411 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:22.049853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] Creating event network-vif-deleted:63ac2d0a-da4f-44c4-befa-11e028960fed for instance f436c21c-2168-42dc-940a-75b7e9319477 on hv-cinder-84889 Aug 24 14:46:22.057164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-dcdd529f-8779-4ec6-a3ef-b8f7bb558204 req-e49825aa-0cbe-4fa3-b166-ae1e13d60bb9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066494 Aug 24 14:46:22.062621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 265/533] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:22.065693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:22.075675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2e7ac166-7639-42dc-b542-7faa7c303d7a tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1465 microversion: 2.1 time: 0.125598 Aug 24 14:46:22.076431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 269/534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:21 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1465 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:22.616561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:22.617126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:22.626879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:22.627361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:22.627786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:22.631614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:22.632182 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:22.632604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:22.806626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:22.818846 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b057b22-2214-4cc0-af23-30a98cd72ea4 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1364 microversion: 2.1 time: 0.206923 Aug 24 14:46:22.827750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 266/535] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:22 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:23.102365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:23.103236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:23.110359 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:23.111199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:23.111594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:23.112543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:23.113137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:23.113813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:23.163051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:23.164378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:23.165061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:23.165749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'fault' on Instance uuid f436c21c-2168-42dc-940a-75b7e9319477 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:23.213100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:23.225679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-157914a6-66d0-470f-b170-ff8345716e6b tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 200 len: 1311 microversion: 2.1 time: 0.131357 Aug 24 14:46:23.227053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 270/536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:23 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 1311 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:23.819063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ccf6056e-eb48-419a-b915-df7ab9bac239 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'create', calling method: .version_select at 0x7f87499ceca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1597281825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWxKXDHDroJknyiekHqys7yledqdAe3bkuIJoYiyUxD5upA6BlwscLhgxOSuRE8FkR2UzFQyioRbVPo5kwaO3yGc0XD1tsdGwX4bFMjEAPkhcSchsXydTuZG66+glyodw=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:23.837007 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-ccf6056e-eb48-419a-b915-df7ab9bac239 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Getting quotas for project 95acd5e8956e411dbb929970259a5b04. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:23.841127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-ccf6056e-eb48-419a-b915-df7ab9bac239 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Getting quotas for user 9240ad6e51074a7a9d4f6338dbce7254 and project 95acd5e8956e411dbb929970259a5b04. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:23.856146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:23.856820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:23.863966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:23.864555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:23.864984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:23.865643 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ccf6056e-eb48-419a-b915-df7ab9bac239 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050479 Aug 24 14:46:23.865838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:23.866094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:23.866596 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 267/537] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:46:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:23.866988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:23.924306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-493593808", "imageRef": "5e3b78b4-0836-4665-9a74-b738add16fdd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1597281825", "networks": [{"uuid": "950376ab-60b3-4871-b958-10e69307f318"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:23.980902 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] validate_networks() for [('950376ab-60b3-4871-b958-10e69307f318', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:24.016593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:24.024487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4ffcd6c7-b3a2-4cd4-a1d9-1503cecf5991 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1550 microversion: 2.1 time: 0.172321 Aug 24 14:46:24.025036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 271/538] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:23 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1550 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:24.044585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:24.045068 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:24.051746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.052222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.052647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.053325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.053769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.054184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.130438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-47f178ab-a35d-474d-bfba-be027d9e24fe tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089830 Aug 24 14:46:24.131093 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 272/539] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:46:24 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:24.248232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:24.249117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: f436c21c-2168-42dc-940a-75b7e9319477] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:24.252678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:24.257543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.258370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.259056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.259852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.260501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.261143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.279927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] HTTP exception thrown: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Request method failure captured: Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 HTTP/1.1 Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhuSgEoowesTUETXCMXkefDEzMPfYQQutwmxZaFStHtasQklb6IOHxEZSVYbxi8EHg5NJztgMcuse4M4Y2cInmWTzQ2YTi1tz8yMRq11DFVqCGWmqFNnl6MJwzSHsPEputZjZUK4FQzn94IFqyJD_MnBmY7V2f0Oz1QCuXosjRCdDU Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:46:24.281755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d39aed3397c47b7a361a0036c2f0eeb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 9cef72df53e14cc39db936f6737d842c Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. Aug 24 14:46:24.283396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'f436c21c-2168-42dc-940a-75b7e9319477'} Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:24.284291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. Aug 24 14:46:24.285782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:24.287153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Returning 404 to user: Instance f436c21c-2168-42dc-940a-75b7e9319477 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:24.287988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b8e4a9ac-3ce6-4a63-b908-5f42ea8a59cf tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477" status: 404 len: 111 microversion: 2.1 time: 0.041209 Aug 24 14:46:24.290676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 273/540] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:24 2022] GET /compute/v2.1/servers/f436c21c-2168-42dc-940a-75b7e9319477 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:24.299142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:24.302320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:24.309291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.310029 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.310544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.311372 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.311939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.312708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.338879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:24.421253 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:24.422037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:24.422952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:24.423369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:24.423834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:24.429853 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d335997f-d74b-4799-a78c-7d0bf8f7d25e tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 204 len: 0 microversion: 2.1 time: 0.136673 Aug 24 14:46:24.430732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 274/541] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:24 2022] DELETE /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:46:24.433433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.434181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.434535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.435813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.436444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.437027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.444152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:24.445789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:24.453711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.454217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.454689 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.455399 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:24.455881 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:24.456411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:24.459518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Getting quotas for project 95acd5e8956e411dbb929970259a5b04. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:24.466022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Getting quotas for user 9240ad6e51074a7a9d4f6338dbce7254 and project 95acd5e8956e411dbb929970259a5b04. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:24.483646 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:24.486220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e3b78b4-0836-4665-9a74-b738add16fdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:24.547933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fa14f605-c2b3-4b45-b583-bcb5f801d60c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621334 Aug 24 14:46:24.547933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 268/542] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:46:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:46:24.553838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fda71694-a777-4cfd-a587-c3cfe831953e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:24.554485 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fda71694-a777-4cfd-a587-c3cfe831953e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:24.614454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fda71694-a777-4cfd-a587-c3cfe831953e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:24.624674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fda71694-a777-4cfd-a587-c3cfe831953e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1258 microversion: 2.1 time: 0.074903 Aug 24 14:46:24.626636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 269/543] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:24 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:24.833198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:24.842849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d4b06f31-c710-4c25-8dbe-a28a5572bf34 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.405554 Aug 24 14:46:24.856496 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 275/544] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:24 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:25.246700 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757a173f-507c-4199-a601-85202e5a39b2", "tag": "165edf10-f1f8-4b1d-ba94-b350f4f46a1b"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:25.257183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:25.257648 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:25.258068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:25.269425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] Creating event network-changed:165edf10-f1f8-4b1d-ba94-b350f4f46a1b for instance 757a173f-507c-4199-a601-85202e5a39b2 on hv-cinder-84889 Aug 24 14:46:25.276978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-ca374682-2543-4b02-ac3f-f2e82dd17f35 req-9e828fba-ecf2-480f-a161-7e1d5dcc0c1e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034009 Aug 24 14:46:25.277951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 270/545] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:25.647586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:25.648204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:25.655283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:25.655762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:25.656163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:25.656874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:25.657625 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:25.658137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:25.723967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:25.732447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b2b506f5-4bde-4204-b5eb-280a9188afd5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1262 microversion: 2.1 time: 0.090020 Aug 24 14:46:25.733067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 276/546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:25 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:25.869556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:25.870022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:25.872419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:25.877686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:25.878164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:25.878839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:25.879549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:25.880671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:25.881285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:26.056643 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:26.066276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fc9b9ae0-d6d3-4749-9ba2-2b7751073146 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.202055 Aug 24 14:46:26.067382 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 271/547] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:25 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:26.753491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:26.754050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:26.761115 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:26.761590 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:26.762015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:26.762752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:26.763272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:26.763685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:26.827458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:26.836622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d3ce4106-c91d-4c30-b425-0f5b926bc9d1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1262 microversion: 2.1 time: 0.087091 Aug 24 14:46:26.837187 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 277/548] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:26 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:27.088758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:27.089882 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:27.097362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:27.098062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:27.098576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:27.099379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:27.099922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:27.100422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:27.292909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:27.313620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3f437c75-69d2-4842-8249-3d73f3c26b19 tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1521 microversion: 2.1 time: 0.228747 Aug 24 14:46:27.315160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 272/549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:27 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:27.857691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:27.858345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:27.864879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:27.865353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:27.865774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:27.866480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:27.866930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:27.867336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:27.960875 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:27.975314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d185147f-33d1-4b80-822b-f2391e894a2f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1310 microversion: 2.1 time: 0.120964 Aug 24 14:46:27.977620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 278/550] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:27 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1310 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:28.083236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618665e1-aacd-4ca7-873b-a47102ccfcb1", "name": "network-vif-deleted", "tag": "f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:28.100125 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:28.100940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:28.101052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:28.128815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] Creating event network-vif-deleted:f73a3801-19b2-44c1-9fd6-dc83f8b2a7ac for instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 on hv-cinder-84889 Aug 24 14:46:28.145062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-35d7a4b4-2e87-4062-b7f5-d0203117829b req-30de7e04-70ec-446c-8953-19edf41a44c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065340 Aug 24 14:46:28.146319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 273/551] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:28.341709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:28.342350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:28.351139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:28.351629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:28.352066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:28.352784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:28.353236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:28.353657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:28.397170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:28.397170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:28.397170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:28.397170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lazy-loading 'fault' on Instance uuid 618665e1-aacd-4ca7-873b-a47102ccfcb1 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:28.692341 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cef72df53e14cc39db936f6737d842c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d39aed3397c47b7a361a0036c2f0eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:28.700642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9485cadd-adac-4243-b646-36989d64d7fa tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 200 len: 1311 microversion: 2.1 time: 0.363260 Aug 24 14:46:28.701206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 279/552] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:28 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:29.001233 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:29.003026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:29.027197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:29.030702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:29.031302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:29.032924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:29.033833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:29.036265 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:29.146774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:29.165442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-39ec40b0-7c33-4b20-b4aa-32fac705e093 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1316 microversion: 2.1 time: 0.171282 Aug 24 14:46:29.168267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 274/553] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:28 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:29.722627 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:29.723259 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] [instance: 618665e1-aacd-4ca7-873b-a47102ccfcb1] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:29.733124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:29.733964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:29.734751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:29.735726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:29.736176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:29.736596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:29.756650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] HTTP exception thrown: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Request method failure captured: Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 HTTP/1.1 Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhuSgEoowesTUETXCMXkefDEzMPfYQQutwmxZaFStHtasQklb6IOHxEZSVYbxi8EHg5NJztgMcuse4M4Y2cInmWTzQ2YTi1tz8yMRq11DFVqCGWmqFNnl6MJwzSHsPEputZjZUK4FQzn94IFqyJD_MnBmY7V2f0Oz1QCuXosjRCdDU Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:46:29.758939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d39aed3397c47b7a361a0036c2f0eeb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d39aed3397c47b7a361a0036c2f0eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 6d39aed3397c47b7a361a0036c2f0eeb Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004656249 Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 9cef72df53e14cc39db936f6737d842c Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004656249-project Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. Aug 24 14:46:29.760481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '618665e1-aacd-4ca7-873b-a47102ccfcb1'} Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:29.761314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. Aug 24 14:46:29.762816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:46:29.766365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] Returning 404 to user: Instance 618665e1-aacd-4ca7-873b-a47102ccfcb1 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:29.767426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7ccec72c-ad78-42fe-8301-ea5c6ea5b70f tempest-ServerRescueNegativeTestJSON-1004656249 tempest-ServerRescueNegativeTestJSON-1004656249-project] 10.222.0.90 "GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1" status: 404 len: 111 microversion: 2.1 time: 0.049100 Aug 24 14:46:29.771521 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 280/554] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:29 2022] GET /compute/v2.1/servers/618665e1-aacd-4ca7-873b-a47102ccfcb1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:30.199040 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:30.200368 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:30.207335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:30.207832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:30.208369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:30.209207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:30.209691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:30.210118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:30.397203 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:30.410260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ac8d6015-3342-42c9-b56c-f19f108643d2 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.216458 Aug 24 14:46:30.411602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 275/555] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:30 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:31.448773 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:31.450074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:31.457436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:31.458192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:31.458647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:31.459570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:31.460076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:31.460487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:31.495827 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:31.699364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:31.707398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7dd8207d-19a4-4965-88e5-7461b1deb5a3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.279424 Aug 24 14:46:31.708653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 281/556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:31 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:32.729694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:32.731032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:32.743493 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:32.744652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:32.750591 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:32.754862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:32.756391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:32.757039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:33.024439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:33.041860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f3580da7-3115-4237-bc51-cf08ed7c3dde tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.316205 Aug 24 14:46:33.043139 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 276/557] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:32 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:34.072274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:34.073585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:34.084026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:34.095778 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:34.097255 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:34.098184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:34.098845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:34.100031 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:34.632805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:34.648714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-81c1bcdf-6273-459a-93ac-c34bca6fbb1a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.587920 Aug 24 14:46:34.656976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 282/558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:34 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:35.690841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:35.692162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:35.695075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:35.696128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=12 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:35.701952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:35.702471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:35.702953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:35.704247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:35.704700 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:35.705799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:35.907586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:35.917505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-224b106f-e3c7-4cab-a361-306f9056251c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.231281 Aug 24 14:46:35.918341 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 277/559] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:35 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:36.949252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:36.949252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:36.955594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.956103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.956795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.957469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.957910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.958542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:37.187448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:37.196769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-22e3e638-2207-4691-8b48-84cc0e6a21bb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.256649 Aug 24 14:46:37.197352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 283/560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:36 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:37.831393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:37.871760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:37.874751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:37.875809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:37.918022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] Creating event network-changed:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:46:37.934836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d0f6f216-4515-40a7-ac11-787dbfcf7948 req-8c65d7b7-c156-4e4f-90b4-e84b1c125cb7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124061 Aug 24 14:46:37.937506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 278/561] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:38.227292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:38.233238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:38.240488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.241199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.241859 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.242807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.243538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.243920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.532688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:38.541091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c14c6a8d-6aa8-442f-8035-e451d5b8c748 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.319167 Aug 24 14:46:38.551973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 284/562] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:38 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:39.562332 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:39.562946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:39.569994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:39.570974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:39.571585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:39.572763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:39.573531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:39.574228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:39.916921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:39.926377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-81aa9de8-01cc-4735-8b42-784b45c12271 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.368575 Aug 24 14:46:39.926980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 279/563] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:39 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:40.951722 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:40.952358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:40.959885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.960427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.960895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:40.962072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.962640 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.963310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:41.139285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:41.151345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-218ac795-b0b3-410c-80fb-36de97fbae33 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.204950 Aug 24 14:46:41.152516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 285/564] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:40 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:41.731523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4e5e81a8-0c99-4846-9240-792f163093d6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: .version_select at 0x7f8749a389d0>, body: {"keypair": {"name": "tempest-keypair-1460457661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQ8CncXNb4oE7oB9NKtdGoWSzd+tknrGh4h6Ga7LrOoV4UHi3BnuC/OpMGx5BwZ7vjHTY59Ez5L62e5a+kHTlcJAlkb+0B/j+8VxmF6Z17CAvKdVU6gNHeJTQ4TpY4vw=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:41.747632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-4e5e81a8-0c99-4846-9240-792f163093d6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:41.753444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-4e5e81a8-0c99-4846-9240-792f163093d6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for user b0b28db79b1b4a97a26c1df848bc4de5 and project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:41.779799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4e5e81a8-0c99-4846-9240-792f163093d6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.175745 Aug 24 14:46:41.780584 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 280/565] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Aug 24 14:46:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:46:42.173578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:42.175556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:42.182937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:42.183423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:42.183824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:42.184842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:42.185476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:42.186057 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:42.390419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:42.401107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7f4a3bd5-d15c-43e0-bea6-261e4c47457f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.232355 Aug 24 14:46:42.414642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 286/566] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:42 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:43.289644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-642769565", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a2efdad-9d2c-424f-baba-3976626f3ebf"}], "security_groups": [{"name": "tempest-securitygroup--1563569754"}], "key_name": "tempest-keypair-1460457661", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:43.403807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] validate_networks() for [('2a2efdad-9d2c-424f-baba-3976626f3ebf', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:43.428674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:43.429574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:43.439139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.440129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.441010 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.442349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.443807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.444652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.632343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:43.641525 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6f881aae-d352-4e46-bbc1-11d0c1f78be3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.216592 Aug 24 14:46:43.642213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 287/567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:43 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:43.848094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:43.848568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:43.849050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:43.849622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:43.850350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:43.863489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.863972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.864507 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.865239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.865689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.866105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.884450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:43.888514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for user b0b28db79b1b4a97a26c1df848bc4de5 and project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:43.901396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:43.904157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:43.966689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d846beb-500c-4415-8c3d-6b5c39682bb6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.681432 Aug 24 14:46:43.971901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 281/568] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Aug 24 14:46:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 14:46:43.979364 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:43.980291 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:44.061240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:44.069754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:44.071495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:44.072808 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d6a42d44-4db2-48fa-9a90-5a8c3b8b8f1d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1281 microversion: 2.20 time: 0.098077 Aug 24 14:46:44.089885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 288/569] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:43 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:44.433996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "name": "network-vif-plugged", "status": "completed", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:44.454330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:44.455097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:44.455514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:44.471475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] Creating event network-vif-plugged:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:46:44.480492 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-8af9bc52-785a-4cb6-b309-5fd59b5b541d req-7367b28c-acb4-4db3-aa99-46120c46650a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136475 Aug 24 14:46:44.481238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 282/570] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:44.665283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:44.666028 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:44.679264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:44.680126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:44.681189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:44.682608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:44.683405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:44.684682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:44.861178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:44.871487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9bc05bce-12e0-494a-a5d1-0eb3a6e81b8a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.208972 Aug 24 14:46:44.885990 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 289/571] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:44 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:45.097172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:45.097811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:45.104530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.105152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.105579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.106308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.106786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.107202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.180692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:45.196992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:45.198501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:45.199660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-27ebf71a-5b4c-4cb1-87fb-1f2b94c9ccdc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1333 microversion: 2.20 time: 0.107202 Aug 24 14:46:45.200317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 283/572] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:45 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:45.894238 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:45.895101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:45.902026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.902605 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.903023 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.903760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.904210 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.904628 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.069943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.078867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8632ac13-d2a6-4410-aabc-88d4fd100f53 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1358 microversion: 2.1 time: 0.189264 Aug 24 14:46:46.089011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 290/573] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:45 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:46.222282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:46.223112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:46.229826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:46.230306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:46.230936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.231727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:46.232174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:46.232601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.305987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.314933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.316477 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.317603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-16f4fc92-e94c-440e-a7af-e7fecde7747f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1341 microversion: 2.20 time: 0.099489 Aug 24 14:46:46.318176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 284/574] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:46 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:46:47.103966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.105438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.116650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.117378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.118108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.119370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.120065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.120811 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.297114 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.307668 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-189971ae-7d48-4e00-a87b-5c8dba380c7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1547 microversion: 2.1 time: 0.210174 Aug 24 14:46:47.320669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 291/575] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1547 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:47.327116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.327770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.334487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.334999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.335449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.336130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.336577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.336994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.341677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:47.351102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.351720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.360388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.360879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.361317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.362023 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.362692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.363379 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.436768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.451065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.453230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.455461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7ca6fcf4-f4bf-41f9-9af9-87032e71d6a2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1339 microversion: 2.20 time: 0.107973 Aug 24 14:46:47.456237 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 292/576] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:46:47.540653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.551511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ecf63d78-f050-45da-bbc3-fd6b8c62a3b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1547 microversion: 2.1 time: 0.228312 Aug 24 14:46:47.552103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 285/577] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1547 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:47.572249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.577135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.577894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Searching by: {'deleted': False, 'project_id': '95acd5e8956e411dbb929970259a5b04'} {{(pid=127296) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 14:46:47.584729 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.585208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.585636 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.586585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.587206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.587625 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.687656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.multi_cell_list [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127296) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 14:46:47.798938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-06bae74e-d88c-48a3-a633-d7a5b62633e3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.230540 Aug 24 14:46:47.806222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 293/578] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:47.811370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.811979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.828185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.828850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.829587 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.830829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.831624 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.832198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.137334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:48.151356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8a76d690-da9e-44a8-917f-88a00c25e2b5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1547 microversion: 2.1 time: 0.343473 Aug 24 14:46:48.152335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 286/579] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1547 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:48.488510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:48.496338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:48.506467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.507203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.508147 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.509769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.510855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.511840 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.564494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:48.595181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.596023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.596819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.636986 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] Creating event network-changed:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:46:48.646156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-3189f545-0279-4a36-8e52-def2f2e533e0 req-9af55d32-e30f-42ac-8a2e-c92649f070d4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087879 Aug 24 14:46:48.647361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 287/580] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:48.755411 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:48.764987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:48.766900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:48.768027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-85604624-a692-4843-82b9-aa5e3626f9f5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.288364 Aug 24 14:46:48.768746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 294/581] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:48 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:49.793234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:49.794316 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:49.803192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.804010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.804753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.805896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.806721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.807453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.910393 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67094e71-4fe1-406d-ac24-51f2a3ae7cf9"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:49.913063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:49.919652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.920138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.920574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.921264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.921918 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.922494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.963550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:49.972660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:49.973811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:49.976037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-932cb12d-afab-4505-88bb-5bad8066d8fb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.188600 Aug 24 14:46:49.976037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 288/582] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:49 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:50.846940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-969adf6c-c331-488f-a39c-4a8714a167ce tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940304 Aug 24 14:46:50.847557 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 295/583] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:46:49 2022] POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:50.998423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:50.999265 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:51.005905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:51.006413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:51.006850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:51.007551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:51.007993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:51.008404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:51.224790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:51.235060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:51.236829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:51.238327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a8348ac6-4e22-4cab-806d-5d1385373254 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.244012 Aug 24 14:46:51.239110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 289/584] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:50 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:46:52.265828 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:52.266992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:52.273574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:52.274054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:52.274476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:52.275203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:52.275617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:52.276075 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:52.424686 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:52.436311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:52.438851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:52.440425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2b2c5953-1361-4d78-a727-6d40be7d9398 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.180193 Aug 24 14:46:52.441109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 296/585] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:52 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:53.464653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:53.465321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:53.472177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:53.472692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:53.473124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:53.473813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:53.474261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:53.474721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:53.616546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:53.625637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:53.627171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:53.628282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8144b8f2-c45c-446e-8ddf-9fa402433eb3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.167679 Aug 24 14:46:53.628849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 290/586] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:53 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:54.173080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "name": "network-vif-plugged", "status": "completed", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:54.179697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:54.187130 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:54.187824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:54.188313 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:54.201903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] Creating event network-vif-plugged:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:46:54.207404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-3b56de4a-9316-42ab-ab78-da9c170b5e6e req-af9bcba6-b51e-463a-85d4-7c8871631c9d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038220 Aug 24 14:46:54.208228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 297/587] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:54.652802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:54.653468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:54.655638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:54.656300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=10 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:54.662640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:54.663080 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:54.663532 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:54.664225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:54.664693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:54.665104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:54.807480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:54.819112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:54.821161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:54.822695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0a5fac00-3565-46e2-baf1-ecc9a31ff31f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.174600 Aug 24 14:46:54.823459 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 291/588] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:54 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:55.847486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:55.848193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:55.850746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:55.856949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:55.857439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:55.857870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:55.858604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:55.859169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:55.859598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:55.865320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:56.017541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:56.030034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:56.032258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:56.033692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b11d9ac4-1842-4f13-9799-4ef4085025e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1407 microversion: 2.20 time: 0.190881 Aug 24 14:46:56.034311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 298/589] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:55 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:57.057593 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:57.058186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:57.060702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:57.070052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:57.070948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:57.071710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:57.072682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:57.073198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:57.073689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:57.218758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:57.227514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:57.229159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:57.230472 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fbe260e2-64f7-4dd6-8f00-b1687e25ab5a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1599 microversion: 2.20 time: 0.176755 Aug 24 14:46:57.231435 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 292/590] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:57 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:57.266334 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:57.267474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:57.276113 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:57.277000 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:57.277560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:57.278647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:57.278958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:57.279392 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:57.386246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-622cce02-8a73-4b62-a860-1bac32a5b21c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124321 Aug 24 14:46:57.387347 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 299/591] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Aug 24 14:46:57 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:46:58.525283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:58.525898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:58.532100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.532406 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.532841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.533531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.533985 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.534414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.777486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:58.782605 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:58.784971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-220c0e21-8c29-4b84-8b54-29b6178607d6 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1593 microversion: 2.1 time: 0.264119 Aug 24 14:46:58.785752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 293/592] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:58 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1593 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:58.797607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:58.805461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.805461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.805461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.822833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] Creating event network-changed:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:46:58.828070 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-ac2c4626-83e7-41ce-8cab-1b511a3a6f98 req-1e32df61-b040-4c7a-93e7-340ddb45fe1e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050794 Aug 24 14:46:58.829609 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 300/593] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:01.196606 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:01.213486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:01.214327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:01.215152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:01.236109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] Creating event network-changed:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:47:01.241721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-60fe9ecf-64b5-4852-9dc9-3ad58215e521 req-ba809e1e-38a4-4fbd-8478-e96254a30a6c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048730 Aug 24 14:47:01.242878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 294/594] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:02.926273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-603486977"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:02.927373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:02.933697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:02.934194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:02.934683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:02.935374 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:02.935810 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:02.936228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.079145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.network.security_group_api [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Adding security group 45dcddc0-bdfd-4f78-99c0-e186e7794202 to port db60cdcb-2cef-4c75-b557-4483f80e293e Aug 24 14:47:03.427549 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ddba2da0-43e6-468a-b285-6b095cab8174 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action" status: 202 len: 0 microversion: 2.1 time: 0.505790 Aug 24 14:47:03.428562 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 301/595] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:02 2022] POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:03.440676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:03.442355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:03.442603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:03.453839 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.454157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.454433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.454666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.454924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.455679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.456997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.457598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.458126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.468232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] Creating event network-changed:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:47:03.488019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-be3d8d6a-1a89-4c0a-b9e7-d8ee1db3dbac req-59dcbdb4-9c10-464e-8517-5e4f40ce9210 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054532 Aug 24 14:47:03.488684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 295/596] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:03.757931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:03.775606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e76d9cda-0dfa-4e45-af69-88943bd037fb tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1758 microversion: 2.1 time: 0.341905 Aug 24 14:47:03.778708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 302/597] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:03 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1758 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:08.807027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:08.807732 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:08.816471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:08.817071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:08.817632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:08.818855 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:08.819456 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:08.820314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:08.847556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4e09288f-ea3e-4374-a102-147bf895b6db tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/ips" status: 200 len: 145 microversion: 2.1 time: 0.046986 Aug 24 14:47:08.848137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 296/598] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:47:08 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:10.204654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "577a8b98-8f03-4521-a0da-01e99abf8edc"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:10.207164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:10.216326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:10.216811 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:10.217252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:10.217944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:10.218390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:10.218842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:10.543499 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bc4bdb40-2ce6-41b6-a565-3de2a5ccdc0e tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342585 Aug 24 14:47:10.544524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 303/599] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:47:10 2022] POST /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:18.179387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:18.181620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:18.189605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.190115 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.190568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.191352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.191808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.192228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.195227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=57 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:18.227059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ee08c218-b820-4ebd-bcd8-11287f0883bc tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051634 Aug 24 14:47:18.227661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 297/600] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:47:18 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:18.240124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:18.240704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:18.247485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.247958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.248379 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.249060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.249508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.249913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.282162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1711a3b0-7e78-4b11-9054-c44737ec7a96 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc" status: 200 len: 194 microversion: 2.1 time: 0.047157 Aug 24 14:47:18.282900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 304/601] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Aug 24 14:47:18 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:19.676174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "802d8a9c-0d51-42f1-9af9-99182798ebf6"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:19.678643 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:19.685650 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.686135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.686600 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:19.687407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.687853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.688323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:20.013629 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-84fe1485-dbbc-4ee3-85eb-033b4904fa71 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "POST /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341555 Aug 24 14:47:20.014250 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 298/602] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:47:19 2022] POST /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:24.885697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:24.886689 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:24.893891 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.894377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.894841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.895541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.895988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.896406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.926601 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lazy-loading 'flavor' on Instance uuid 505f9752-9301-4986-87d7-d9541817e046 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:25.019972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-27489a4f-aeb5-4c69-b4c5-c5396a6e15a6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "POST /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046/action" status: 202 len: 0 microversion: 2.1 time: 0.138409 Aug 24 14:47:25.020576 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 305/603] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:24 2022] POST /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:25.034255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:25.035006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:25.042027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.042551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.043084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.043819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.044273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.044701 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.210205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:25.222629 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3574fa01-7654-459f-b80f-0a1e0f7c3f4a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.196053 Aug 24 14:47:25.223258 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 299/604] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:25 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:26.248529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:26.249202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:26.251315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=16 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:26.257439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.257915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.258340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.259073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.259520 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.259938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.262902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:26.439624 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:26.449679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-44bf83b3-c48b-42d2-b967-46db3d4307f0 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.205959 Aug 24 14:47:26.450474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 306/605] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:26 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:27.478128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.480285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.482792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=16 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:27.488413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.488900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.489334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.490047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.490498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.490942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.668782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:27.677419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f9793c39-a5e0-4e83-aaa8-a55ba17f296e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.204322 Aug 24 14:47:27.678014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 300/606] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:27 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:27.696864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.700017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.707833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.708379 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.708927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.709574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.710016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.710430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.747605 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c21556fa-7918-412a-8eba-cc75cb544413 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055651 Aug 24 14:47:27.748178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 307/607] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:47:27 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:27.896032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.896958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.906953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.907686 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.908299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.909307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.909963 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.910545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.963496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c87e4876-75b8-4f4b-bb45-6ffd506284d5 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc" status: 200 len: 194 microversion: 2.1 time: 0.075534 Aug 24 14:47:27.964297 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 301/608] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Aug 24 14:47:27 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:27.978139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.978803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.988268 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.989043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.989757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.990972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.991711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.992412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.104323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'services' on Instance uuid 757a173f-507c-4199-a601-85202e5a39b2 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:28.207845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-35512fb2-bb47-4002-a172-63a16a8567f8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc" status: 202 len: 0 microversion: 2.1 time: 0.235672 Aug 24 14:47:28.208468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 308/609] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:47:27 2022] DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/577a8b98-8f03-4521-a0da-01e99abf8edc => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:28.700828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:28.701486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:28.708687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.709166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.709592 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.710761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.710761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.711594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.860635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:28.873895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-678535d4-7cdf-4328-92a4-ec8289bbd600 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.176866 Aug 24 14:47:28.874932 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 302/610] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:28 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:29.905412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:29.906169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:29.912819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:29.913301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:29.913727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:29.914404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:29.914884 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:29.915297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.073985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:30.083092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cfb7e201-4f50-4f69-a978-5c8760e694d2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.182508 Aug 24 14:47:30.083675 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 309/611] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:29 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:30.443578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:30.444346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:30.457939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.458424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.458895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.459602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.460055 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.460481 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.490798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-14863c90-d152-4fb9-96a2-156ef5b65c48 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/802d8a9c-0d51-42f1-9af9-99182798ebf6" status: 200 len: 194 microversion: 2.1 time: 0.052920 Aug 24 14:47:30.491488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 303/612] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Aug 24 14:47:30 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/802d8a9c-0d51-42f1-9af9-99182798ebf6 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:30.503388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:30.503712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:30.510306 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.510860 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.511319 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.512051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.512495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.512909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.603257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'services' on Instance uuid 757a173f-507c-4199-a601-85202e5a39b2 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:30.697954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ce3e3c55-d603-4f2f-8d13-9b7f6541f173 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/802d8a9c-0d51-42f1-9af9-99182798ebf6" status: 202 len: 0 microversion: 2.1 time: 0.198731 Aug 24 14:47:30.699133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 310/613] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:47:30 2022] DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments/802d8a9c-0d51-42f1-9af9-99182798ebf6 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:47:31.106330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:31.106868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:31.113749 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.114267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.114732 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.115460 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.115903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.116326 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.280663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:31.288978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5743fedc-c6c7-48d0-8629-631d62d85d82 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.186864 Aug 24 14:47:31.289552 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 304/614] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:31 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:31.915262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:31.917832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:31.925100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.925569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.926030 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.926797 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.927361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.927720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.961630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-339e7083-e5e5-455d-a47d-51bcfd74364d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051612 Aug 24 14:47:31.962197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 311/615] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:47:31 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:47:32.089112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:32.091424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:32.097977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.098460 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.098932 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.099624 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.100070 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.100503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.130673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e8183770-e5f1-4637-b02b-0d25c1fa005d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045431 Aug 24 14:47:32.131244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 305/616] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:47:32 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:47:32.201634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:32.202236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:32.209546 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.210024 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.210532 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.211239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.211687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.212129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.238161 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:47:32.310781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:32.311389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:32.317556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.318039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.318471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.319208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.319653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.320130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.326438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6e659c4e-dddc-4edb-828f-6f3ad0933020 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 204 len: 0 microversion: 2.1 time: 0.126955 Aug 24 14:47:32.331676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 312/617] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:47:32 2022] DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:47:32.338653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:32.339243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:32.345938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.346422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.346931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.347598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.348045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.348460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.490187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:32.503671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a62045a-cfdf-4235-b8df-4ef7efaa3689 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.196674 Aug 24 14:47:32.504782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 306/618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:32 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:32.521454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:32.533071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-897571f5-d6ff-4fc9-bc8e-d9256f9e0b9f tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1674 microversion: 2.1 time: 0.199943 Aug 24 14:47:32.533672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 313/619] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:32 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:33.536133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:33.536738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:33.543825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.551431 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.551882 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:33.552613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.553067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.554003 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:33.556204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:33.557212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:33.565891 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.571997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.572716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:33.574008 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.577046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.577732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:33.730729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:33.740603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3aaaff26-a5ff-46fb-9354-a42ff80db5ae tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.208991 Aug 24 14:47:33.741524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 307/620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:33 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:33.760356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:33.769548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0073ec0c-10f5-4864-af0f-937e946a93cf tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1674 microversion: 2.1 time: 0.218128 Aug 24 14:47:33.770137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 314/621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:33 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:34.767523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:34.768687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:34.780224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:34.782134 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:34.782310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:34.783475 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:34.784260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:34.784962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:34.795535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:34.796956 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:34.808086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:34.808873 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:34.809572 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:34.810744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:34.811478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:34.812154 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:34.977390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:34.986642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a727d1f0-6b25-4ef5-915c-48bb8989e9d8 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1674 microversion: 2.1 time: 0.198145 Aug 24 14:47:34.999413 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 315/622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:34 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:35.023397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:35.031702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9f44a4b5-546a-49b0-a5aa-1822299de0cd tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.271369 Aug 24 14:47:35.032298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 308/623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:34 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:35.832952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757a173f-507c-4199-a601-85202e5a39b2", "name": "network-vif-deleted", "tag": "165edf10-f1f8-4b1d-ba94-b350f4f46a1b"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:35.848558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:35.849421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:35.849866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:35.864638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] Creating event network-vif-deleted:165edf10-f1f8-4b1d-ba94-b350f4f46a1b for instance 757a173f-507c-4199-a601-85202e5a39b2 on hv-cinder-84889 Aug 24 14:47:35.870457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-f6f0919f-5b3e-400a-9a11-6b82beb89b85 req-19fba02a-90ad-4b2c-b1f1-b7014f6dbe95 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042111 Aug 24 14:47:35.871762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 316/624] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:36.019886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:36.020590 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:36.034264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.035603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.036554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.043545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:36.047217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:36.049602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.050292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.052921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.062936 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.071587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.072178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.074892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.079792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.084317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.123015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.123787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.124224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.125038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'fault' on Instance uuid 757a173f-507c-4199-a601-85202e5a39b2 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:36.170964 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:36.180141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bcb6a5e9-d670-4dcc-865e-aa76f20d8baa tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1328 microversion: 2.1 time: 0.170194 Aug 24 14:47:36.182138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 309/625] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:36 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:36.187471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:36.188455 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:36.198487 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.198879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bca61f6b-6b09-47bb-b2f4-d96d069c3260 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action" status: 202 len: 0 microversion: 2.1 time: 0.159513 Aug 24 14:47:36.199826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.200027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 317/626] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:36 2022] POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:36.200768 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.202645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.203534 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.204259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.209053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:36.209913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:36.219731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.220380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.220824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.221552 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.222016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.222554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.414489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:36.424390 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0c73fbe2-e820-49aa-87ef-e9b9597fcc73 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.240580 Aug 24 14:47:36.425288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 310/627] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:36 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:36.599285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:36.608986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ea601554-ee96-443b-8158-ed18d1c38cb7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1750 microversion: 2.1 time: 0.405237 Aug 24 14:47:36.609577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 318/628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:36 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1750 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:37.212730 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:37.213386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:37.222142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.222939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.223697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.224892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.225629 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.226272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.261781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.262260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.262727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.263185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lazy-loading 'fault' on Instance uuid 757a173f-507c-4199-a601-85202e5a39b2 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:37.309382 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623364d853c42a88a7172adfa07ef89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a3af4911cf4cdf99ee22cba5e82e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:37.311639 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:37.324865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c9f3dce5-0f71-4883-aafc-7aabe46ee758 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 200 len: 1328 microversion: 2.1 time: 0.117129 Aug 24 14:47:37.325452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 311/629] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:37 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:37.453598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:37.454192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:37.462326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.462953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.463384 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.464076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.464556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.464979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.481026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:37.617412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:37.625920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-51ec4efe-626e-4bfd-a765-59e1fbb209b5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.176189 Aug 24 14:47:37.626573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 319/630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:37 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:37.634587 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:37.635208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:37.643443 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.643903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.644329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.645038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.645465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.645886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.818863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:37.827502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3caa9661-d7c5-4d72-841e-0995a51dcc05 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1750 microversion: 2.1 time: 0.198205 Aug 24 14:47:37.828079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 312/631] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:37 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:38.346371 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:38.346920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:38.353369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.353861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.354293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.355038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.355488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.355907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.373934 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 HTTP/1.1 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:47:38.375648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:38.377286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '757a173f-507c-4199-a601-85202e5a39b2'} Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:38.378215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:38.379820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:38.385480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:38.385480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1390ca78-a6b4-410c-acbf-ebddb01b354d tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 404 len: 111 microversion: 2.1 time: 0.034772 Aug 24 14:47:38.385480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 320/632] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:38 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:38.388065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1a056348-1540-494b-8d0e-3429dc6c6e8b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '.version_select at 0x7f8749e48820>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:38.417130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1a056348-1540-494b-8d0e-3429dc6c6e8b tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858365123" status: 202 len: 0 microversion: 2.1 time: 0.034656 Aug 24 14:47:38.417814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 313/633] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858365123 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:47:38.658320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:38.658964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:38.670818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.671312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.671737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.672527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.672968 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.677148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.850899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:38.851679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:38.859523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.860059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.860490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.861199 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.861702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.862065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.020657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:39.035111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0c6e12e7-b1d8-4c61-8ab5-4def679b5ba4 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.388521 Aug 24 14:47:39.036498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 321/634] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:38 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:39.064163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:39.076658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a507efdf-fb21-43ec-891e-feff74ccb7b9 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1750 microversion: 2.1 time: 0.230722 Aug 24 14:47:39.077225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 314/635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:38 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:39.741230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:39.742018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:39.753433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.754594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.755337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.756454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.757156 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.757845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.790026 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:47:39.885421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-32a0f790-8b4f-4bc8-9c9d-50ed28b71780 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 204 len: 0 microversion: 2.1 time: 0.149807 Aug 24 14:47:39.887226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 322/636] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:47:39 2022] DELETE /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:47:39.902801 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:39.905550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:39.918015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.919016 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.919971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.921289 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.922122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.923244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.072755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:40.074055 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.086540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.086540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.087065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.088444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.089457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.090422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.094875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:40.103950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5f930926-e652-43ef-84e7-1fe4829c2d26 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1579 microversion: 2.1 time: 0.210778 Aug 24 14:47:40.104490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 315/637] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:39 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:40.110086 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:40.110895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.120501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.121568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.122428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.123192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.123736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.124217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.269918 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:40.281452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a9c4c43a-5f2a-49fe-b640-84b154a21df6 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1511 microversion: 2.1 time: 0.219418 Aug 24 14:47:40.283044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 323/638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:40 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:40.313985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:40.314679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.318439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:40.323733 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.323733 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.324012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.324476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.324914 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.325321 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.332512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d9a7ebde-7fd5-412e-b779-a9bebbb440a8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.226762 Aug 24 14:47:40.348689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 316/639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:40 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:40.378916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127296) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:47:40.453493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f746c9b4-0ade-4a30-9e3b-6ff6f4f9b7cb tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "POST /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046/action" status: 202 len: 0 microversion: 2.1 time: 0.143084 Aug 24 14:47:40.454456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 324/640] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:40 2022] POST /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:40.464672 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:40.465320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.471579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.472053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.472477 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.473163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.473604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.474013 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.646427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:40.656286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2ea168a2-8755-489c-8759-113d81c95d4f tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1519 microversion: 2.1 time: 0.195633 Aug 24 14:47:40.656974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 317/641] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:40 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:41.129205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.129827 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.137863 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.138464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.138929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.139636 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.140089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.140667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.304753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.313132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a07bbcac-abe9-4fa0-9950-df52e678b3ff tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1579 microversion: 2.1 time: 0.188865 Aug 24 14:47:41.313721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 325/642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:41 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:41.354022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.354655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.362099 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.362626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.363185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.364310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.364746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.365153 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.543489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.553465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0133e0f1-0cc6-4c8c-9149-5a4c8c9899ff tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.203220 Aug 24 14:47:41.554146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 318/643] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:41 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:41.682281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.683355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.693315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.694066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.694780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.695831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.696422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.697172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.861621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.870492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f63f59db-2094-4e9b-aba7-69b821e77c50 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1519 microversion: 2.1 time: 0.195402 Aug 24 14:47:41.871118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 326/644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:41 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:41.910436 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.910971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.917103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.917744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.918176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.918897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.919429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.919894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.934999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 HTTP/1.1 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:47:41.936860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.938434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '757a173f-507c-4199-a601-85202e5a39b2'} Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:41.939426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.940697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.942043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:41.942043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8c9473a0-acb7-4942-9679-bb68fca47053 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 404 len: 111 microversion: 2.1 time: 0.031852 Aug 24 14:47:41.942043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 319/645] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:47:41 2022] DELETE /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:41.947951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.948566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 757a173f-507c-4199-a601-85202e5a39b2] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.956658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.957488 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.958198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.958923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.959390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.959789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.975696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 HTTP/1.1 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:47:41.977398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.979047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '757a173f-507c-4199-a601-85202e5a39b2'} Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:41.980043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. Aug 24 14:47:41.982312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:41.983579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 757a173f-507c-4199-a601-85202e5a39b2 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:41.983579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f8f07f7a-d252-4e55-9c54-bcb44a306685 tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2" status: 404 len: 111 microversion: 2.1 time: 0.035506 Aug 24 14:47:41.983579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 327/646] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:41 2022] GET /compute/v2.1/servers/757a173f-507c-4199-a601-85202e5a39b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:42.339457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:42.340357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:42.348621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.349108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.349544 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.350249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.350727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.351352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.428858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "name": "network-vif-unplugged", "status": "completed", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:42.444735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.445505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.446264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.459206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.compute.server_external_events [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] Unable to find a host for instance 505f9752-9301-4986-87d7-d9541817e046. Dropping event network-vif-unplugged {{(pid=127296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 14:47:42.460637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-187d0d43-f2e4-4999-8e8f-cc56b8b204a6 req-3ba7b445-7f1e-4958-abd5-364dbcfd522e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035790 Aug 24 14:47:42.461476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 328/647] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 14:47:42.550977 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:42.560296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-efa60360-5d2c-4892-80c2-39f21a82d0e5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1579 microversion: 2.1 time: 0.226565 Aug 24 14:47:42.561138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 320/648] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:42 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1579 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:42.580853 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:42.583456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:42.596149 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.596750 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.597894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.598315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.598833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.599267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.895857 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:42.896751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:42.903774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.905541 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.906153 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.907147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.907753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.908321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.011445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.025405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1407f198-8122-4726-addb-085da4ecc66c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.452707 Aug 24 14:47:43.026697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 329/649] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:42 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:43.074522 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.083237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e92d86cf-31ef-4a9a-87e1-9ee0135bbd49 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1521 microversion: 2.1 time: 0.192529 Aug 24 14:47:43.084146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 321/650] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:42 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:43.170190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.170747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.177126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.177831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.178389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.179209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.179816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.180350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.196588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 HTTP/1.1 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:47:43.198326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.200289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '9bb600b0-9df3-4758-9663-8b67de110251'} Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:43.201389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.202588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.204205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:43.204205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4dcad402-9f68-4c67-8249-e126a93015da tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 404 len: 111 microversion: 2.1 time: 0.036197 Aug 24 14:47:43.204205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 330/651] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:47:43 2022] DELETE /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:43.216273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.216991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] [instance: 9bb600b0-9df3-4758-9663-8b67de110251] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.223307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.223908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.224417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.225184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.225711 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.226205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.241016 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] HTTP exception thrown: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Request method failure captured: Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 HTTP/1.1 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjhzhceXU8_zXBPOzsKubatJFwB4wfWy384tw1vJyXpEIlpHWDTn392NmgsEd2HqTADUz5gNikFccO92xkR5br_iTEKt-vN5Aq4Ifk_dpgFcgs_2CTdLAPfL9LVLknE10jjf8InVGOUAv96Rs1SpRQM3NWdF5h8Pd2UiGgEAh2_3o9o Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:47:43.242689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e0a3af4911cf4cdf99ee22cba5e82e57", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e0a3af4911cf4cdf99ee22cba5e82e57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: e0a3af4911cf4cdf99ee22cba5e82e57 Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-716378682 Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 1623364d853c42a88a7172adfa07ef89 Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeTestJSON-716378682-project Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.245111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '9bb600b0-9df3-4758-9663-8b67de110251'} Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:43.246946 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. Aug 24 14:47:43.248444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:47:43.249767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] Returning 404 to user: Instance 9bb600b0-9df3-4758-9663-8b67de110251 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:43.249767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-eb9bf3f3-67bc-46e6-87a8-065436667a9c tempest-AttachVolumeTestJSON-716378682 tempest-AttachVolumeTestJSON-716378682-project] 10.222.0.90 "GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251" status: 404 len: 111 microversion: 2.1 time: 0.035957 Aug 24 14:47:43.249767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 322/652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:43 2022] GET /compute/v2.1/servers/9bb600b0-9df3-4758-9663-8b67de110251 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:43.471631 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7baf2ec3-7427-4668-8143-7f2e344315ac", "name": "network-vif-deleted", "tag": "5c374eaa-7c49-4edb-99d7-01abb44bdcd3"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:43.486310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.487352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.488102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.509152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] Creating event network-vif-deleted:5c374eaa-7c49-4edb-99d7-01abb44bdcd3 for instance 7baf2ec3-7427-4668-8143-7f2e344315ac on hv-cinder-84889 Aug 24 14:47:43.519180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-eb0afb5a-2d08-4578-b273-f60c47fad8b7 req-d510b777-a808-45fc-82e8-6314b7ab6287 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055194 Aug 24 14:47:43.521075 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 331/653] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:43.584254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.586296 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.602446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.603348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.603981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.605483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.606152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.607899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.719206 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.728496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-631417e6-4ec5-40b5-8da6-b642c17d4884 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1512 microversion: 2.1 time: 0.150978 Aug 24 14:47:43.729741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 323/654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:43 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:43.821372 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.822132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.837780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.838593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.842302 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.843251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.843959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.844529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.884322 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-10e8047b-b27f-4e52-9682-2b8ccdea8862 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/ips" status: 200 len: 152 microversion: 2.20 time: 0.074907 Aug 24 14:47:43.885518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 332/655] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Aug 24 14:47:43 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/ips => generated 152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:47:44.050149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:44.050986 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:44.061266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.061938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.062653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.063556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.064340 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.064934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.111780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:44.113908 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:44.137618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.139740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.140461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.143242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.146290 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.147495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.795678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:44.825084 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e061cc5c-bca4-4d37-8dc5-4b72b278825c tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.723608 Aug 24 14:47:44.826844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 333/656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:44 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:44.837719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:44.839524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:44.862115 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.864543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.865771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.887225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.888462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.889160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.930971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:44.951452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f0bb77c5-7604-47c1-9287-faa82a2b0e6a tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.905728 Aug 24 14:47:44.953211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 324/657] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:44 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:44.997547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.998297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.998906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.999518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lazy-loading 'fault' on Instance uuid 7baf2ec3-7427-4668-8143-7f2e344315ac {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:45.071340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:45.079650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1dee4816-01ba-4ee9-a4fc-acc5b1976785 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 200 len: 1185 microversion: 2.1 time: 0.251478 Aug 24 14:47:45.080506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 334/658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:44 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 1185 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:45.928003 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:45.928620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:45.941117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.941872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.942601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:45.943327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.943780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.944541 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:45.980742 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:45.981555 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:45.988638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.989169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.989878 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:45.990610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.991121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.991734 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.184220 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:46.193863 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0b64c9c0-41ca-4860-9f8b-0cea8e03de8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.217227 Aug 24 14:47:46.194782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 335/659] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:45 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:46.200135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:46.201156 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:46.207428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.208268 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.209194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.210012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.210597 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.211114 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.231531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] HTTP exception thrown: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Request method failure captured: Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac HTTP/1.1 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjlU1P7Y-Oj7FEFn8B9_YyfH25DAkeBYZTEiYHrOdZXgT4uq4kjLMqdYtdI6QuQq-vzDex9EokvZe9PXghfpw3gACi2t_oamLJLtTGWlb7JA9b4BuvNwfxZJ-zamNOr4iWYoZ-VNdt7ZsmcoSRCwrf8QPEUnfd4IVDqkhum5ts0XMrQ Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:47:46.233340 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aeb3927a2464f7fb5b0c7f8b5b70b83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-TestVolumeBootPattern-71528761 Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: ac02340a58d14a91858b7741772460f6 Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:47:46.236354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '7baf2ec3-7427-4668-8143-7f2e344315ac'} Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:47:46.238251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:47:46.242594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:47:46.244754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Returning 404 to user: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:47:46.244754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-df7f78fc-128d-45d4-a4c7-3bf4d2037115 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 404 len: 111 microversion: 2.1 time: 0.038795 Aug 24 14:47:46.245704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 336/660] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:46 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:47:46.291696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:46.309868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-abc987af-9a44-43f8-8b0a-1ce8d81e4ec2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.385860 Aug 24 14:47:46.310839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 325/661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:45 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:46.388472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1780281068", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2063152975", "security_groups": [{"name": "tempest-secgroup-smoke-204705932"}], "block_device_mapping_v2": [{"uuid": "2b314dfe-107e-4191-8de1-572ca60098fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29258503-d20d-4638-a36b-45ed3774b302"}]}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:46.524940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] validate_networks() for [('29258503-d20d-4638-a36b-45ed3774b302', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:47:46.857167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:46.857705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:46.868819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.869953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.871496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.871496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.871770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.872096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.902938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lazy-loading 'flavor' on Instance uuid 95c28cb3-2878-47e2-97a0-c8534823a20a {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:46.991898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:47:46.992916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:47:46.993388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:47:46.993794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:47:46.994224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:47:47.003892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.004375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.004978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.006214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.006919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.007527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.028511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:47:47.033858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for user ac02340a58d14a91858b7741772460f6 and project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:47:47.115461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:47:47.118976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b314dfe-107e-4191-8de1-572ca60098fc',volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:47:47.177375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bf8d6d40-f6a2-43e5-9965-07d3df755d6a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/action" status: 202 len: 0 microversion: 2.20 time: 0.323703 Aug 24 14:47:47.182176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 326/662] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Aug 24 14:47:46 2022] POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:47:47.193180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.194186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.203924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.204412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.204847 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.205582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.206028 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.206445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.311454 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7482373c-7d61-449a-aa09-061aa7714334 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926852 Aug 24 14:47:47.312464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 337/663] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:47:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:47:47.317662 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.318795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.323129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:47.333087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.334190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.335159 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.336348 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.336967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.337612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.356969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:47.468776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.483387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.485682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.487445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-042f866c-935e-4ceb-9129-8ed134238074 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.303833 Aug 24 14:47:47.489018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 327/664] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:47.496696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da694e00-f702-4628-858f-385b74a35837 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.497313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da694e00-f702-4628-858f-385b74a35837 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.569445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da694e00-f702-4628-858f-385b74a35837 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.579905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da694e00-f702-4628-858f-385b74a35837 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1095 microversion: 2.1 time: 0.088717 Aug 24 14:47:47.594473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 328/665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:47.600872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.601870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.608569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.609427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.610163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.611071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.611680 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.612245 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.709887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.722864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ede15459-e7fb-41a5-b84d-a306390f9c8d tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.408931 Aug 24 14:47:47.724434 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 338/666] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:47.817863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.820838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:47.834306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-85ed77dd-5517-44a3-a2b7-17be2c9ed556 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.238321 Aug 24 14:47:47.839845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 329/667] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:48.520705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:48.521392 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:48.528573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.529063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.529494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.530191 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.530691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.531108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.606138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:48.607249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:48.615503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.616162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.616598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.617308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.617759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.618216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.685512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.693812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8979c6d6-0bbf-4015-9411-51cb3e760469 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1193 microversion: 2.1 time: 0.095995 Aug 24 14:47:48.694315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 330/668] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:48 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:48.760187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:48.760561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:48.768208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.770416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.774313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.774921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.775763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.777714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.779565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.781610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.784130 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.799583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d6edf792-6c50-4695-b8d7-f4225e9b613e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.286249 Aug 24 14:47:48.801011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 339/669] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:48 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:48.868750 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:48.870502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:48.882058 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.882862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.883465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.884489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.885133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.885831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.161374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:49.182102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-67252fbd-40ee-4af3-9c89-9da86ac45996 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.429962 Aug 24 14:47:49.183965 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 331/670] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:48 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:49.184158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:49.193225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2d3cf9ed-5863-4edb-a953-ae50d181b15e tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.335402 Aug 24 14:47:49.196612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 340/671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:48 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:49.718969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:49.720654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:49.728355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.728913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.729417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.730219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.730774 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.731338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.829873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:49.831209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:49.833195 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:49.848787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2423e72-5a87-488c-a3a1-17c90b50ab0d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1211 microversion: 2.1 time: 0.136032 Aug 24 14:47:49.849372 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.850221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.851201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.852195 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.853690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.854310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.867340 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 332/672] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:49 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:50.103429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.113378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.115118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.117317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d78eb409-57db-49ce-9fe6-b24c64ce8f85 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.294302 Aug 24 14:47:50.118721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 341/673] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:49 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:50.208143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:50.209323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:50.224125 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:50.225149 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:50.225416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.226319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.228997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.231710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.233018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.233599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.254448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.256580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.260486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.263586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.264253 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.264848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.590695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.602885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3ac24a95-13c4-4b4f-93c8-99a438f4334f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.400015 Aug 24 14:47:50.611931 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 333/674] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:50 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:50.629222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.640089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4c9319d5-baad-49b5-bdbd-feb804dcabc5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.429150 Aug 24 14:47:50.642078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 342/675] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:50 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:50.875136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:50.877087 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:50.886329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.887162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.887628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.888989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:50.889923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:50.891343 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.146582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.151688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:51.152462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:51.159758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.160231 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.162713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.163844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.164529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.164726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f3a42afd-a5fb-4713-94a9-1d165054b2cd tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.295418 Aug 24 14:47:51.165378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.180136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 334/676] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:50 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:51.193580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eca882b-6163-4c18-8d99-313b4bc8a216", "tag": "e4f969e4-4c2a-4a6b-acaa-c919ed6eb681"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:51.205447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.206203 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.206821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.222453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] Creating event network-changed:e4f969e4-4c2a-4a6b-acaa-c919ed6eb681 for instance 1eca882b-6163-4c18-8d99-313b4bc8a216 on hv-cinder-84889 Aug 24 14:47:51.228886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d2f709f6-3722-40ce-80f6-22922130f911 req-6eec9b03-3c92-4aa0-920a-6f7a87ba24aa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041329 Aug 24 14:47:51.240628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 335/677] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:51.528180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.539721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.541243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.542709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0098d0c4-185b-4383-8071-40137e61ac9f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.394998 Aug 24 14:47:51.544942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 343/678] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:51 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:51.630952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:51.632044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:51.640208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.641616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.642384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.643379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.643987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.645006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.684817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:51.686420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:51.697094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.698423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.702779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.703621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.704164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.704709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.868884 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.888711 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-720d83ab-bf1d-4df0-99cf-5a1d117787f7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.262453 Aug 24 14:47:51.893902 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 336/679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:51 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:52.004983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.017357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3632511d-9e71-4c65-b3b7-5df6634c00c3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.340550 Aug 24 14:47:52.018368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 344/680] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:51 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:52.196110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:52.196973 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:52.204854 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.206017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.206614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.207559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.208256 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.208869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.567695 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:52.569057 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:52.577720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.578686 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.579333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.580351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.581027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.581692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.784870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.795383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-30d7f24a-b498-419a-a6de-e3f2f5ff9b72 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.603645 Aug 24 14:47:52.796293 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 337/681] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:52 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:52.851298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.862260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.864318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.866478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b96f0372-a395-4181-9d06-f050b6f109f2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.302368 Aug 24 14:47:52.868130 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 345/682] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:52 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:52.921552 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:52.923232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:52.931798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.932713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.933370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.934327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.935243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.935934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.044018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:53.044678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:53.052445 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.053212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.053801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.054714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.055323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.055899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.279348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:53.293237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6bf7b2df-1a80-4f54-a986-2f69b3599577 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.379680 Aug 24 14:47:53.293416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 338/683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:52 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:53.628245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:53.652561 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c69650c2-589b-47c6-ac2f-3a6be453be63 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.614251 Aug 24 14:47:53.658091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 346/684] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:53 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:53.820560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:53.820560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:53.826951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.827440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.828082 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.828941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.829553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.830440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.892202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:53.893350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:53.926898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.930330 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.943668 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.946535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.949781 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.953794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.009868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.035607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a412fa35-8c51-4b80-b4a4-d1e3886dfb09 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.222574 Aug 24 14:47:54.037501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 339/685] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:53 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:54.217186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.227942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.230312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.231959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a3e7fede-778b-4acf-b53a-8fe9b5fe9efc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.346206 Aug 24 14:47:54.243083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 347/686] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:53 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:54.315900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:54.316515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:54.324922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.325411 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.325838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.326789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.327271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.327897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.505948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.515384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b1021a4c-8b36-4ca8-8f8e-36b03ec62df5 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.203278 Aug 24 14:47:54.516257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 340/687] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:54 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:54.583670 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "name": "network-vif-plugged", "status": "completed", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:54.595423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.596510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.597210 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.614928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] Creating event network-vif-plugged:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:47:54.623186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-015a50bd-c894-4299-bed6-29c4e6376da4 req-8e69f511-a1f7-4b1f-9dc5-faa12e6f509d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042773 Aug 24 14:47:54.624501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 348/688] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:54.690038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:54.691000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:54.707642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.708135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.709746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.710473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.711155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.711753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.934629 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.956288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8e3ce39b-6901-4f71-b698-80f61f33708a tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.273586 Aug 24 14:47:54.958387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 341/689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:54 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:55.059208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:55.059796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:55.072225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.072720 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.073182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.073901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.074395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.091819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.257537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:55.259717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:55.269243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.269243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.269243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.269243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.276126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.276126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.367889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:55.378688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-67e29cd4-e698-4878-a1f1-41a4d0a60e91 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.323970 Aug 24 14:47:55.379277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 349/690] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:55 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:55.435489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:55.455879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:55.457566 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:55.461128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7bfa33aa-3203-47ea-9172-dba2f3829e69 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.206397 Aug 24 14:47:55.461128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 342/691] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:55 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:55.539616 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:55.540343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:55.547044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.547681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.548165 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.549035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.549481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.549903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.814916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:55.838850 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0cd90362-a14d-41dc-9998-c431bbb31a01 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.302391 Aug 24 14:47:55.839903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 350/692] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:55 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:55.984684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:55.985509 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:55.993705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.994369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.994842 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.995597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.996043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.996458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.225605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.234374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ae3356ae-c0a8-4338-ada3-aaa52a80fcd5 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1577 microversion: 2.1 time: 0.253526 Aug 24 14:47:56.235333 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 343/693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:55 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:56.356100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dbc3f74a-1988-414d-9110-34c8755fcf9d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: .version_select at 0x7f874993d160>, body: {"keypair": {"name": "tempest-keypair-1706157381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDzLqoMJdc/0GJUaxxkalvVPt9Eyk8tYuGR9+E925BMfl3VIj9fVX9+xzx6As2zeXuOirl0ig3UmNjOHc3OIXoRwroa5bpP+33sDoDcCCg1INY1PJmJfBbBq5YvwIHfMg=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:56.371716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-dbc3f74a-1988-414d-9110-34c8755fcf9d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:47:56.375598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-dbc3f74a-1988-414d-9110-34c8755fcf9d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:47:56.406838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dbc3f74a-1988-414d-9110-34c8755fcf9d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.280418 Aug 24 14:47:56.407423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:56.415265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 351/694] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:47:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:56.415491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:56.415491 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.416085 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.416633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.417446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.417982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.418999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.499820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:56.500567 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:56.509273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.509768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.510271 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.511243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.511697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.512118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.604140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.612980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-744ef2f9-e080-4d47-abac-e98d37209abf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.209239 Aug 24 14:47:56.613465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 344/695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:56 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:56.703320 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.717991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.719563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.720769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bd56654a-46f1-4240-a2ae-985b246123c5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.225084 Aug 24 14:47:56.721361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 352/696] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:56 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:56.877055 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:56.878046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:56.885815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.886305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.886930 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.887679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:56.888247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:56.888877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.072071 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.082254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a7039b3d-60c7-4ff2-8051-61477aa5dba3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1755 microversion: 2.1 time: 0.210834 Aug 24 14:47:57.082878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 345/697] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:56 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:57.258119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:57.258752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:57.260819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:57.267997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.268483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.268907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.269594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.270035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.270451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.482883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.494127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6c85b30-dad5-4148-b842-44965b3aa3da tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1564 microversion: 2.1 time: 0.239859 Aug 24 14:47:57.494906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 353/698] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:57 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1564 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:57.638047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:57.639341 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:57.643676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:57.644376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:57.649305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.650401 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.650880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.651832 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.652738 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.653196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.747148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:57.747846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:57.754296 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.755060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.756025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.756940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.757542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.758225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.826735 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.845978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ed499209-3fb5-4e9e-9a86-632cdbec826e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.212125 Aug 24 14:47:57.860100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 346/699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:57 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:58.053033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.070842 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.072365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.073664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b65c1f95-a362-4d95-977a-e257fbbea741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.332680 Aug 24 14:47:58.075052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 354/700] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:57 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:58.107875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:58.108902 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:58.119233 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.119703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.120500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.121671 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.122564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.123415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.129185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:58.197375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1311172320", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5895cdf-b3b8-44b7-8473-a928f868e86e"}], "security_groups": [{"name": "tempest-securitygroup--517802776"}], "key_name": "tempest-keypair-1706157381", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:58.322556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.331693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-46d4e9cd-b734-44e9-ba5d-bde42266aff7 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1758 microversion: 2.1 time: 0.231037 Aug 24 14:47:58.333132 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 347/701] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:58 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:58.362836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] validate_networks() for [('e5895cdf-b3b8-44b7-8473-a928f868e86e', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:47:58.751512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:47:58.752104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:47:58.752387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:47:58.752789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:47:58.753198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:47:58.762138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.762647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.763080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.763799 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.764247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.764669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.781643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:47:58.785663 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:47:58.797222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:47:58.799577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:47:58.850282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2f6a8655-7803-4349-a8d2-65d4ed19a1b7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.664806 Aug 24 14:47:58.855093 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 355/702] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:47:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:47:58.869815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-24ea9e30-5bfd-4efe-8c5d-37f477eaed38 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:58.872161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-24ea9e30-5bfd-4efe-8c5d-37f477eaed38 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:58.892730 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:58.893456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:58.907887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.908658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.909474 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.911477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.912097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.913317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.983231 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-24ea9e30-5bfd-4efe-8c5d-37f477eaed38 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.994707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-24ea9e30-5bfd-4efe-8c5d-37f477eaed38 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1242 microversion: 2.1 time: 0.133308 Aug 24 14:47:58.995989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 348/703] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:58 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:59.093865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.100662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:59.101282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:59.103974 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b06e3f59-1e81-4619-a20c-fe4a0d3aead9 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.240073 Aug 24 14:47:59.104766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 356/704] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:58 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:59.108798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:59.109281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:59.109703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:59.110391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:59.110865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:59.111282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:59.300628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.312480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.314800 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.316282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6d04001a-ae9b-414b-a0f8-d0c57f5817b5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.219734 Aug 24 14:47:59.317857 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 349/705] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:59 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:00.018193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:00.018936 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:00.028105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.028803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.029403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.030301 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.031455 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.032202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.048485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:00.120848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.132836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8af89877-dfdd-441b-aa98-e4bcec409084 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1294 microversion: 2.1 time: 0.120258 Aug 24 14:48:00.133662 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:00.134446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 357/706] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:00 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:00.135736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:00.144728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.145599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.146577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.147913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.148575 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.149189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.291289 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.299661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8a525306-e9a1-40b0-8758-2dcf06c1c06c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.177630 Aug 24 14:48:00.300305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 350/707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:00 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:00.342038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:00.342531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:00.349345 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.349830 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.350249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.350997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.351442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.351863 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.539034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.553139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.555360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.556721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8d6add77-bd2a-4b56-90ec-c29a1908bcec tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.218907 Aug 24 14:48:00.558162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 358/708] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:00 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:01.156994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:01.158377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:01.165854 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.166330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.166814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.167519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.167954 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.168588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.263380 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:01.272036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-919f021a-a9d4-4350-a66e-687773243376 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1300 microversion: 2.1 time: 0.119403 Aug 24 14:48:01.273358 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 351/709] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:01 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:01.321722 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:01.322325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:01.329034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.329527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.329962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.330704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.331293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.331587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.520415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:01.532205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e50a480d-b097-4b91-b658-9418d1c89b45 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.214807 Aug 24 14:48:01.533368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 359/710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:01 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:01.582255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:01.583011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:01.593371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.593981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.594725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.595808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.596256 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.596700 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.850901 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:01.865167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:01.866804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:01.868013 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-66ea4590-d3df-41a9-ba35-48811c4dcde6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.290612 Aug 24 14:48:01.869221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 352/711] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:01 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:02.249984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94b0efc-7058-4b0c-a81b-ed4dd135d600", "tag": "46c20040-507e-43f9-b13a-f22f62fcff44"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:02.264821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.265554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.266784 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.284728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] Creating event network-changed:46c20040-507e-43f9-b13a-f22f62fcff44 for instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 on hv-cinder-84889 Aug 24 14:48:02.291887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-1f2812e3-3782-47e4-ab45-ee3bf53d17cd req-0cc43810-2f96-439f-8b68-f41eb2bd394b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045533 Aug 24 14:48:02.292775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 360/712] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:02.294299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:02.303498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:02.310227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.311080 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.311685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.312605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.313610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.314445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.554494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:02.555323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:02.562912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.563667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.564347 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.565085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.565647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:02.566025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.566700 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.582072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-80de5124-3f2d-4488-a695-723ff6ff5bee tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.292129 Aug 24 14:48:02.609795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 353/713] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:02 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:02.623497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eca882b-6163-4c18-8d99-313b4bc8a216", "name": "network-vif-plugged", "status": "completed", "tag": "e4f969e4-4c2a-4a6b-acaa-c919ed6eb681"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:02.643536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.644563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.645162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.663524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] Creating event network-vif-plugged:e4f969e4-4c2a-4a6b-acaa-c919ed6eb681 for instance 1eca882b-6163-4c18-8d99-313b4bc8a216 on hv-cinder-84889 Aug 24 14:48:02.668943 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-dcc93355-f87f-4669-8b24-b14f158335e9 req-ff9f8bec-4429-4879-94be-aa794e1814a2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056995 Aug 24 14:48:02.669917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 354/714] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:02.770214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:02.783318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-522a54ab-f06b-4d82-9324-f6cd554d4131 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.233177 Aug 24 14:48:02.784398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 361/715] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:02 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:02.895604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:02.896645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:02.903743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.904604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.905088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.905777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.906216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.906657 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.069957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.078282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.079792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.080954 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-60d3e783-7dad-4823-a96c-fac47bd50a6b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.190488 Aug 24 14:48:03.081506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 355/716] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:02 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:03.627083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:03.627634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:03.635431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.636461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.636461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.637011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.637451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.637857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.783580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.791803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8acd2cbc-3b2e-46e1-8d41-8b002b024419 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.168636 Aug 24 14:48:03.794581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 362/717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:03 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:03.807741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:03.808878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:03.816408 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.816952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.817399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.818090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.818942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.819104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.969674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.978149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d52db77-ba99-4964-99ec-b909b7ae8e5a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.174542 Aug 24 14:48:03.978757 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 356/718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:03 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:04.103416 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:04.104043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:04.110538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.111063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.111498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:04.112194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.112639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.113052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:04.275516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.285677 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.287241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.288419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0c394e37-1503-4a0f-8943-50b5e7fa5fee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.189209 Aug 24 14:48:04.289035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 363/719] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:04 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:04.814137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:04.815087 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:04.825342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.826150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.826639 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:04.827353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.827806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.828229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.002668 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:05.003489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:05.015097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.021232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.022901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.023648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.024387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.025542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.025992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.037504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e3298f25-e78f-49ab-8790-4924dd5f1827 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.227684 Aug 24 14:48:05.039152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 357/720] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:04 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:05.223133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.236759 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-954e8205-ed22-4637-b2bf-2d48d649fb83 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1266 microversion: 2.1 time: 0.238273 Aug 24 14:48:05.237453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 364/721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:04 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:05.314012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:05.315097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:05.324452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.325156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.325602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.326317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.326807 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.327228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.482028 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.491367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.493135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.494421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e1d7699a-20a3-49e5-9f27-e8ee96cdda29 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.186413 Aug 24 14:48:05.495287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 358/722] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:05 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:06.067846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:06.068498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:06.075581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.076001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.076414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.077122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.077558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.077993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.217380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.225222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-34218b4a-0dfd-4d3c-9ee4-9a060461fe0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.161304 Aug 24 14:48:06.225795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 365/723] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:06 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:06.267732 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:06.268334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:06.275391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.275889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.276376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.277062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.277543 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.277909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.413356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.424552 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-80a9cb84-5d13-4997-8a8c-89b0d4e90a79 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1453 microversion: 2.1 time: 0.160975 Aug 24 14:48:06.425130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 359/724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:06 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:06.449758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:06.450940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:06.461327 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.462184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.462973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.464236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.465066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.465834 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.521598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:06.522209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:06.529266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.529755 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.530222 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.530971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.531421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.531830 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.643458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.652950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dbc8d95f-a002-4f04-8cf4-debd14b588fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1453 microversion: 2.1 time: 0.210416 Aug 24 14:48:06.653524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 366/725] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:06 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:06.701053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94b0efc-7058-4b0c-a81b-ed4dd135d600", "name": "network-vif-plugged", "status": "completed", "tag": "46c20040-507e-43f9-b13a-f22f62fcff44"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:06.710445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.726352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.727041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.727599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.734747 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.736958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.738951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-88f83a05-7c38-49f7-b7d9-3886dcafcabe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.221621 Aug 24 14:48:06.739895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 360/726] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:06 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:06.767893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] Creating event network-vif-plugged:46c20040-507e-43f9-b13a-f22f62fcff44 for instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 on hv-cinder-84889 Aug 24 14:48:06.776575 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-fde8ccba-e5e0-4ab1-8419-7a7c485cee44 req-ae238ca3-2bbb-4d42-96ec-8f94172efc1b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082441 Aug 24 14:48:06.778400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 367/727] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:07.247837 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:07.248598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:07.255709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:07.256243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:07.256665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:07.257656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:07.258295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:07.258875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:07.437344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:07.446728 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3065feae-04c6-4219-8c95-63e68253ac3b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.203562 Aug 24 14:48:07.447430 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 361/728] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:07 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:07.789302 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:07.789976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:07.797094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:07.797571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:07.797995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:07.798946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:07.799399 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:07.799822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.025574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.039386 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.042577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.044836 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-171a381c-a395-492f-a826-90cbb3720575 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.261352 Aug 24 14:48:08.045863 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 368/729] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:07 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:08.473559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:08.474878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:08.486548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:08.487507 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:08.488305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.489579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:08.490413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:08.491228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.708221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.717182 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-79a0495f-1f19-4c9c-ab5c-aafb05eb160e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1367 microversion: 2.1 time: 0.250892 Aug 24 14:48:08.717810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 362/730] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:08 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:08.956054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eca882b-6163-4c18-8d99-313b4bc8a216", "tag": "e4f969e4-4c2a-4a6b-acaa-c919ed6eb681"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:08.961421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:08.962681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=16 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:08.969261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:08.969728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:08.970147 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.982423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] Creating event network-changed:e4f969e4-4c2a-4a6b-acaa-c919ed6eb681 for instance 1eca882b-6163-4c18-8d99-313b4bc8a216 on hv-cinder-84889 Aug 24 14:48:08.987484 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-8e29f788-1c42-4227-b607-20401e3feb43 req-f3ae85fc-628a-4241-9a9e-e7728ab65ec8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035587 Aug 24 14:48:08.988261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 369/731] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:09.072888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:09.073981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:09.077376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:09.086681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.087518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.088269 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.089517 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.090326 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.091101 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.283025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.296056 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.299234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.301514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a9d6dd47-621d-4507-ac8d-62b6a1d05262 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.235842 Aug 24 14:48:09.303091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 363/732] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:09 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:09.739053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:09.739805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:09.748366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.748366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.748758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.749431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.750017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.750501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.933937 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.948786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dc2b2468-20ba-4dce-ace3-b34e9dfed79c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1557 microversion: 2.1 time: 0.214376 Aug 24 14:48:09.949795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 370/733] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:09 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:09.986292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:09.987231 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:09.996546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.997006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.997563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.998439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.998908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.999324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.126171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-862dfe2e-21ba-481e-b9ab-80ec5a99ce58 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145736 Aug 24 14:48:10.127597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 364/734] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:48:09 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:10.346443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:10.348676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:10.359216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.360507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.361529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.362769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.363785 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.364844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.663099 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.672900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.674378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.675566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-63ad83f3-648b-4e60-9476-969333d4e186 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.336304 Aug 24 14:48:10.676139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 371/735] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:10 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:11.337693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94b0efc-7058-4b0c-a81b-ed4dd135d600", "tag": "46c20040-507e-43f9-b13a-f22f62fcff44"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:11.349357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:11.349818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:11.350254 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:11.363018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] Creating event network-changed:46c20040-507e-43f9-b13a-f22f62fcff44 for instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 on hv-cinder-84889 Aug 24 14:48:11.368044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-f754de3c-e6c0-467d-861f-108758515bb8 req-a2c7ad3e-5737-4aff-b05b-4128fa0c0b2f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036218 Aug 24 14:48:11.368923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 365/736] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:11.699263 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:11.700118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:11.708217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:11.708929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:11.709412 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:11.710272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:11.711006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:11.711535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:11.918131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:11.930964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:11.933221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:11.934642 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c1ce2eff-249b-462e-b5b8-c4cc475270ba tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.239766 Aug 24 14:48:11.935774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 372/737] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:11 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:12.973496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:12.974385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:12.980906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:12.981395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:12.981831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:12.982551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:12.983008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:12.983435 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:12.998530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:13.144663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.153118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.154782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.155996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8e3658bc-caff-402c-825d-789be184c538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.187441 Aug 24 14:48:13.156656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 366/738] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:12 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:14.179597 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:14.180395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:14.187336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.187814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.188246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:14.188959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.189402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.189820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:14.357966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.366482 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.368003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.369157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6f8098f8-f91c-496d-ab20-8aa33b48e906 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.194233 Aug 24 14:48:14.369792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 373/739] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:14 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:15.393178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:15.393782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:15.400537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:15.401111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:15.401539 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:15.402229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:15.402702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:15.403131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:15.544714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.554970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.556456 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.557644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad115b8c-9ccc-4745-b2ad-f2fa00a04538 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.168998 Aug 24 14:48:15.558271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 367/740] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:15 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:16.581442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:16.582074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:16.588994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.589534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.589976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.590708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.591199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.591612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.737704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.747764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.749260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.750429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0dcc4afd-f42e-4515-8343-8d853d76244e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.173723 Aug 24 14:48:16.751203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 374/741] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:16 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:17.779249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:17.779952 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:17.787158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:17.787647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:17.788082 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:17.788784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:17.789237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:17.789654 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:17.959307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:17.969011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:17.971025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:17.972596 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-97ceb8e8-7006-48f8-9766-aa463d2b90b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.197275 Aug 24 14:48:17.973158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 368/742] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:17 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:19.002309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:19.003055 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:19.007230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:19.016771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.017475 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.018268 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:19.019711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.020057 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.020829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:19.169492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.174903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:19.184118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.185598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.186813 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9622fdda-28a7-44d7-bac7-d3057cd2e441 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.191006 Aug 24 14:48:19.187370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 375/743] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:18 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:20.210053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:20.211091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:20.218282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:20.218795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:20.219235 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:20.219925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:20.220370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:20.220789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:20.361723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.373616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.374938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.375960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-90ecc88b-d8cb-4b0e-8d50-9c9b8763fb16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.170081 Aug 24 14:48:20.376523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 369/744] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:20 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:21.398876 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:21.399621 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:21.406337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.406853 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.407284 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.407969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.408413 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.408825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.563158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.571763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.573343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.574533 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f6393abb-1308-43bb-87d4-2b4f8cb7580d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.179943 Aug 24 14:48:21.575074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 376/745] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:21 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:22.600787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:22.601410 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:22.607609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.608079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.608508 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:22.609186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.609632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.610041 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:22.757308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:22.768369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:22.769821 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:22.771037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5591636c-66ee-47dd-a55d-2a9cf0b94286 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.174580 Aug 24 14:48:22.771605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 370/746] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:22 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:23.796155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:23.797035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:23.806471 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:23.807282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:23.807992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:23.809239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:23.810059 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:23.810802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:23.959882 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.968676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.970248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.971451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9d563d03-63a1-457e-a9ba-4b6541b9f793 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.181466 Aug 24 14:48:23.972005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 377/747] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:23 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:24.995936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:24.996638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:25.003790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.004243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.004674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.005370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.005843 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.006234 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.169284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.178369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.179813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.181167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d8f47224-cc25-4177-bfda-5b0dc22d7508 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.190076 Aug 24 14:48:25.181847 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 371/748] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:24 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:26.204972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:26.205941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:26.212175 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:26.212647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:26.213127 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:26.213820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:26.214258 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:26.214767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:26.366221 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.375536 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.377325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.378779 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d2e427d5-f4a5-46cd-a3ef-487d8cf7bbbf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.177904 Aug 24 14:48:26.379439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 378/749] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:26 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:27.406131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:27.407077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:27.416814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.417872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.418321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.419053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.419509 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.419953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.587307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.596427 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.597917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.599188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e3dacc27-a160-4010-8c36-289e16c4e554 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.199755 Aug 24 14:48:27.599800 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 372/750] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:27 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:28.624553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:28.625518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:28.632218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.632696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.633130 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:28.633846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.634285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.634757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:28.792119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:28.806550 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:28.808162 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:28.809376 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a5a531d9-e4a2-48c8-8245-3588c30f30da tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.190763 Aug 24 14:48:28.809953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 379/751] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:28 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:29.837220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:29.838083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:29.841278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=56 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:29.848514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.848995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.849422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.850171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.850171 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.851220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:30.269246 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:30.284681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:30.286191 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:30.287446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-78c3e772-f493-459b-a844-6239c1ad5a9e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.454440 Aug 24 14:48:30.288008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 373/752] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:29 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:31.312968 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:31.313632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:31.321145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.321653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.322144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.322988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.323490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.323919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.479610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.488672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.490181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.491391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-40048526-6033-4da9-90b2-095c4df42930 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.183606 Aug 24 14:48:31.491955 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 380/753] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:31 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:32.514479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:32.515121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:32.523270 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:32.523928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:32.524452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:32.525228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:32.525858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:32.526392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:32.684284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:32.693689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:32.695208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:32.696440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-791d645a-376d-4be0-a68f-e11ee08d502b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.185946 Aug 24 14:48:32.697049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 374/754] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:32 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:33.725091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:33.725976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:33.734698 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.735217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.735783 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.736524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.737002 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.737415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.903398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.912854 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.914396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.915616 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f99ea1b5-7a30-4b8d-be6b-6de12f1911e6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.195111 Aug 24 14:48:33.916222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 381/755] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:33 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:34.944294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:34.945150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:34.951813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.952292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.952723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.953416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.953869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.954276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:35.107371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.115656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.117138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.118286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e92a3be5-ce81-4699-aedb-c4a939703bf6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.179519 Aug 24 14:48:35.118879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 375/756] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:34 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:36.141978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:36.142740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:36.151896 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:36.152390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:36.152844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:36.153681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:36.154136 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:36.154618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:36.309529 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.319139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.320776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.322011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8f31bf68-ed6f-4f79-a3d1-28800ea7b147 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.184724 Aug 24 14:48:36.322697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 382/757] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:36 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:37.346876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:37.347793 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:37.354848 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:37.355352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:37.355789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:37.356537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:37.356965 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:37.357411 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:37.518636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:37.528030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:37.529637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:37.530905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-be05104c-95d5-42aa-8d89-3dfe0ad41251 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.189233 Aug 24 14:48:37.531517 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 376/758] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:37 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:38.556715 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:38.557348 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:38.565018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:38.565526 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:38.565959 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:38.566883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:38.567339 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:38.567772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:38.714501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.722838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.724281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.725424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ba3df93b-60ae-4bd3-979d-648a0dd3bfd2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.173308 Aug 24 14:48:38.725973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 383/759] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:38 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:39.749079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:39.749715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:39.757598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:39.757929 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:39.758421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:39.759193 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:39.759721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:39.760147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:39.915782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.926729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.928460 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.929735 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-98531a96-2684-4a7e-89f8-df87991c3753 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.184925 Aug 24 14:48:39.930335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 377/760] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:39 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:40.957538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:40.958137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:40.965227 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:40.965707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:40.966133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:40.966878 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:40.967324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:40.967732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:41.114654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.123654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.125145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.126310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-37f8aa1e-f3b6-4c2c-8a18-3752a5552b6c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.172752 Aug 24 14:48:41.126904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 384/761] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:40 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:42.154530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:42.155241 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:42.161909 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:42.162385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:42.162900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:42.163594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:42.164040 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:42.164452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:42.315034 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:42.327571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:42.330179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:42.331862 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-92ce7e5e-5498-4dcb-bd02-7a0eacf795ae tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.181423 Aug 24 14:48:42.332637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 378/762] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:42 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:43.356144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:43.356738 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:43.364792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:43.365639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:43.366435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:43.367678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:43.368480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:43.369235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:43.518274 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.528201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.529613 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.530845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6277bd87-ffe2-42de-8576-06f0a2f330d9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.178682 Aug 24 14:48:43.531408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 385/763] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:43 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:44.554864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:44.555463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:44.562261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:44.562761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:44.563189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:44.563908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:44.564350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:44.564781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:44.567424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=76 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:44.715924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.723666 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.725185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.726353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a74ad897-d797-4d61-a3bf-42f61a110bed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.175764 Aug 24 14:48:44.726956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 379/764] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:44 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:45.748995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:45.749630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:45.758333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:45.759865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:45.759865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:45.763428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:45.763428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:45.763428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:45.920091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.930683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.933280 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.935430 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ba02f871-9d21-47a4-b8b7-f203b1af6dd8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.189976 Aug 24 14:48:45.936388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 386/765] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:45 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:46.973177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:46.974284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:46.983017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.983447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.983876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:46.984650 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.985015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.985414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:47.125091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:47.134220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:47.135741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:47.137026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-daec0711-a861-42e4-b5f4-8bea8e5d666f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.170132 Aug 24 14:48:47.137591 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 380/766] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:46 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:48.161843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:48.162460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:48.171192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:48.171894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:48.172531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:48.173612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:48.174312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:48.174935 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:48.330001 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:48.340003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:48.341647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:48.342860 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ed3b83b6-b5b6-4ba7-82f9-d9f8aa19a6e3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.185629 Aug 24 14:48:48.343659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 387/767] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:48 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:49.368570 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:49.369474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:49.379122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:49.381339 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:49.382130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:49.383811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:49.384685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:49.385520 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:49.563684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:49.572574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:49.574068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:49.575278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-051aaf9f-ea1f-4112-8f16-f4b1be74155e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1745 microversion: 2.20 time: 0.211137 Aug 24 14:48:49.576107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 381/768] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:49 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:50.602754 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:50.603656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:50.607838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=26 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:50.615965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:50.616762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:50.617492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:50.618798 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:50.619658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:50.620391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:50.628256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=74 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:50.808493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:50.818503 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:50.820535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:50.821940 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3879ba83-a33e-4388-bc07-b63c3adb5fce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1745 microversion: 2.20 time: 0.223916 Aug 24 14:48:50.823072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 388/769] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:50 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:51.859585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:51.860634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:51.868167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:51.868839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:51.869273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:51.869959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:51.870568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:51.871091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:52.022373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:52.034888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:52.036374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:52.037596 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2efd21c4-ef9c-4d34-a99b-54ef8c5bc366 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.183747 Aug 24 14:48:52.053230 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 382/770] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:51 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:52.821439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "name": "network-vif-plugged", "status": "completed", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:52.837719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:52.838358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:52.838898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:52.855982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] Creating event network-vif-plugged:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:48:52.862846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-7a6f5d9e-6c23-4663-a8cf-9fb1a3dec548 req-c97eb2cc-9fb5-4a75-96b0-c79d40366249 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045974 Aug 24 14:48:52.864155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 389/771] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:53.065108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:53.066422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:53.074177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:53.074910 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:53.075513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:53.076415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:53.082417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:53.082417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:53.233198 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:53.245493 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:53.247053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:53.248412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-667243a3-98fe-414c-b2bc-1f388979f5d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.190859 Aug 24 14:48:53.250181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 383/772] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:53 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:54.279087 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:54.280903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:54.289424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:54.289979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:54.290496 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:54.291276 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:54.291841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:54.292313 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:54.483567 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:54.493179 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:54.494900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:54.496307 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1a6187e4-e279-464c-9faa-727fe96d4891 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.222568 Aug 24 14:48:54.496835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 390/773] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:54 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:55.524000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:55.526672 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:55.536607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:55.537341 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:55.538122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:55.539347 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:55.540222 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:55.540989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:55.742826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:55.757598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:55.759454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:55.761711 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d5adf427-73c7-4540-b911-361a061272c9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.243510 Aug 24 14:48:55.762308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 384/774] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:55 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:56.066377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:56.067045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:56.074251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:56.074887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:56.075410 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:56.076247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:56.076862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:56.077502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:56.115624 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d5d4b677-87f1-4c22-915d-f46edffe598b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/ips" status: 200 len: 149 microversion: 2.1 time: 0.053870 Aug 24 14:48:56.115624 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 391/775] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:48:56 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:56.795264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:56.797039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:56.804944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:56.805455 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:56.805893 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:56.806682 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:56.807130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:56.808159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:56.999341 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:57.010462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:57.014199 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:57.017289 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-106dfa05-7cf6-4194-abed-4e2aed29bddc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.226305 Aug 24 14:48:57.018504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 385/776] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:56 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:57.680589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b48278a-ac98-40c2-adae-6d2585c3fd02"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:57.682932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:57.690009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:57.690495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:57.690944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:57.691747 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:57.692181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:57.692599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:58.045306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:58.046091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:58.056593 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:58.058083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:58.059618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:58.060823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:58.061608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:58.062031 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:58.137800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-289a73d0-7900-4375-9dda-7a3a3b312bdd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460863 Aug 24 14:48:58.139451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 392/777] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:48:57 2022] POST /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:58.296410 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.311485 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.312994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.314145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-33486078-c2b7-4969-9935-64f322454118 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.273393 Aug 24 14:48:58.314727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 386/778] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:58 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:59.349298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:59.349298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:59.355692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.356199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.356653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.357507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.357972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.358390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.551336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.561468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.563161 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.564665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1c1f536d-5221-4290-a649-4f45e09ad339 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.223988 Aug 24 14:48:59.565611 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 393/779] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:59 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:00.597139 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:00.598005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:00.600843 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=28 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:00.607870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.608393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.608905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.609607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.610050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.610461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.759620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.772918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.774580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.775991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aab6c6b0-b3fb-43b0-bcda-420b5693beee tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1740 microversion: 2.20 time: 0.187247 Aug 24 14:49:00.776725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 387/780] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:00 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:01.801194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:01.801810 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:01.808539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.809015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.809447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.810208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.810761 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.811247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.942069 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-603486977"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:01.943178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:01.951514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.952182 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.952855 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.953645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.954186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.954869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.998283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.007997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.009478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.010654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c75e5ee2-c9fa-4a23-b063-092b61be01fe tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1722 microversion: 2.20 time: 0.214641 Aug 24 14:49:02.011212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 394/781] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:01 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:02.192607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.network.security_group_api [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Removing security group 45dcddc0-bdfd-4f78-99c0-e186e7794202 from port db60cdcb-2cef-4c75-b557-4483f80e293e Aug 24 14:49:02.736879 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a72906b2-5617-4d88-93dc-cfb8ffaf21b0 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action" status: 202 len: 0 microversion: 2.1 time: 0.798468 Aug 24 14:49:02.737451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 388/782] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Aug 24 14:49:01 2022] POST /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:02.747145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:02.758872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.759352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.759806 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.773580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] Creating event network-changed:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:49:02.779993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-0a3a924c-c188-464d-8c3d-8479cdf99deb req-0c929f4e-971f-4259-bc57-6c519bd188f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037725 Aug 24 14:49:02.781086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 395/783] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:03.045064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:03.046658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:03.057628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.058397 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.059699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.060619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.061205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.061714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.240153 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:03.255588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:03.258775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:03.260959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fd45580e-af3b-45f7-ad01-b0747b41532e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1722 microversion: 2.20 time: 0.220970 Aug 24 14:49:03.261983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 389/784] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:03 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:04.242699 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:04.243420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:04.247860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:04.251275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.252073 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.252508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.253681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.253681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.254099 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.260529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.260979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.261597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.279131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] Creating event network-changed:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:49:04.286788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-32483117-8816-46e8-bbd8-522587c8e1ad req-c98aac50-8ca4-4ff5-984c-4038842a0882 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043769 Aug 24 14:49:04.286788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 390/785] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:04.295159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:04.295999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:04.305479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.306000 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.306577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.307365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.307912 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.308610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.364965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lazy-loading 'services' on Instance uuid 99542e48-7ecb-4e78-91c7-e062a63248ff {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:04.457076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5e60cbea-df7d-4b84-934d-4ca237a3d78e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments/67094e71-4fe1-406d-ac24-51f2a3ae7cf9" status: 202 len: 0 microversion: 2.1 time: 0.222059 Aug 24 14:49:04.458144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 396/786] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:49:04 2022] DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments/67094e71-4fe1-406d-ac24-51f2a3ae7cf9 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:04.470009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:04.471818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:04.478928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.479711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.480316 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.481033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.481659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.482444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.516440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2430b985-bcea-4195-9fc8-1784b398e8c3 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052094 Aug 24 14:49:04.517368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 397/787] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:04 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:04.547957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.557338 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.559745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.560370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0d1f2c5a-6447-4689-bf6a-fb0c2f2e8b7f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1722 microversion: 2.20 time: 0.270162 Aug 24 14:49:04.561209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 391/788] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:04 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:04.747482 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "name": "network-vif-unplugged", "status": "completed", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:04.758599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.759354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.760107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.775859 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] Creating event network-vif-unplugged:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:49:04.781788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-7aaf8e72-dd97-46a9-85f2-ec7730d4bb93 req-abac1a79-69dd-4af8-aabe-3af7402b7f5c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039332 Aug 24 14:49:04.782755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 398/789] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:05.529869 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:05.532030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:05.544424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.545799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.547017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:05.548047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.548947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.549476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:05.586413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6d7a5847-1789-44e5-8c77-e21aacb5e35f tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060085 Aug 24 14:49:05.588660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 392/790] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:05 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:05.591954 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:05.592653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:05.603015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.603015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.603015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:05.603015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.603622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.603622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:05.762855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:05.771450 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:05.772922 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:05.774070 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7a531c4e-3e42-43ab-89c0-21832cb1643e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1725 microversion: 2.20 time: 0.186595 Aug 24 14:49:05.774645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 399/791] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:05 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:05.800307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1f0c72c-4da3-4926-80cb-a7858fef029b"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:05.803327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:05.810408 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.810963 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.811421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:05.812275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:05.812847 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:05.813359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.163304 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7fc19193-7028-4eb1-ab33-703f4301ed19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.369721 Aug 24 14:49:06.163995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 393/792] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Aug 24 14:49:05 2022] POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments => generated 188 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:49:06.305821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:06.306406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:06.312924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.313615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.314366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.315096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.315814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.316467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.349184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127296) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:49:06.432768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2e826535-3140-40b7-944a-290d6f58b3f0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/action" status: 202 len: 0 microversion: 2.20 time: 0.131269 Aug 24 14:49:06.433902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 400/793] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Aug 24 14:49:06 2022] POST /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:49:06.446565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:06.447649 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:06.459464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.460337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.461090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.462307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.463218 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.463896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.472391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:06.600487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:06.603721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:06.620639 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.621142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.621685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.622558 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.623248 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.624303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.663089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b61e5d8a-bb45-4a9e-8b7d-8e13a93cce93 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067487 Aug 24 14:49:06.664143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 401/794] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:06 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:06.752066 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:06.761390 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:06.762936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:06.764188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c5932b5d-a161-4c4d-99a2-91ee61f27e81 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1811 microversion: 2.20 time: 0.324909 Aug 24 14:49:06.764763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 394/795] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:06 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1811 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:06.906605 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fe3b8fbf-5f2e-4820-83bb-682eb647d318 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: .version_select at 0x7f8749c22af0>, body: {"keypair": {"name": "tempest-keypair-2134492380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcyp6wQrGbadESZLdHr4VR5mxmpEVAWQ3BoqVR0O2dis2EDC9CIQy3P7RW0C5O1xCwmiworUQe7Tfj9wO7guqE956gXob0oyIRWkaZ+W8IBZB4iyaaYa0gckzpCmJGVPg=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:06.926339 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-fe3b8fbf-5f2e-4820-83bb-682eb647d318 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:06.931593 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-fe3b8fbf-5f2e-4820-83bb-682eb647d318 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:06.959687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fe3b8fbf-5f2e-4820-83bb-682eb647d318 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055659 Aug 24 14:49:06.959687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 402/796] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:49:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:07.676450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:07.679630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:07.687094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.687897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.688018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.688866 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.689731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.692342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.724288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3f59b45c-d80a-480d-a83a-95d4cb0821c1 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051744 Aug 24 14:49:07.725497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 395/797] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:07 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:49:07.736197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:07.737489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:07.744630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.745582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.746216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.747167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.748061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.748719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.789529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:07.791349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:07.801489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.802271 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.802972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.804009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:07.804695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:07.805827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:07.875563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] HTTP exception thrown: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff is not attached to volume 67094e71-4fe1-406d-ac24-51f2a3ae7cf9 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Request method failure captured: Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments/67094e71-4fe1-406d-ac24-51f2a3ae7cf9 HTTP/1.1 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjmra0sHxoBxVrBQ1ZboIQSoTVXHM8J-kZpENxW1mdRSkwD0G91ieKnflfT12JOyrxMStBmUATHDNTo-nh1IVJnIES9Ye_l27Z5L7XVQ4eqMA5P8jk12DgnNXL3w1P-pe5plc7rgFki0dn7lvAdsZ-quRDIc1pb1O-BgB-yQAQDLh4Y Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 95acd5e8956e411dbb929970259a5b04 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:49:07.878902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_95acd5e8956e411dbb929970259a5b04", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 95acd5e8956e411dbb929970259a5b04 Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-TestMinimumBasicScenario-1971651164-project Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 9240ad6e51074a7a9d4f6338dbce7254 Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-TestMinimumBasicScenario-1971651164-project Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:49:07.880309 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff is not attached to volume 67094e71-4fe1-406d-ac24-51f2a3ae7cf9 Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'server_id': '99542e48-7ecb-4e78-91c7-e062a63248ff', 'id': '67094e71-4fe1-406d-ac24-51f2a3ae7cf9'} Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 67094e71-4fe1-406d-ac24-51f2a3ae7cf9. Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:07.881053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff is not attached to volume 67094e71-4fe1-406d-ac24-51f2a3ae7cf9 Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff is not attached to volume 67094e71-4fe1-406d-ac24-51f2a3ae7cf9 Aug 24 14:49:07.882305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:07.885703 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Returning 404 to user: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff is not attached to volume 67094e71-4fe1-406d-ac24-51f2a3ae7cf9 {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:07.886976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-61c9ec78-55c0-40d4-a216-a4c70b9fd123 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments/67094e71-4fe1-406d-ac24-51f2a3ae7cf9" status: 404 len: 154 microversion: 2.1 time: 0.155393 Aug 24 14:49:07.888119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 403/798] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:49:07 2022] DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff/os-volume_attachments/67094e71-4fe1-406d-ac24-51f2a3ae7cf9 => generated 154 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:49:08.106473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:08.132701 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:08.134209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:08.135604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da2cf274-e112-4f15-b8d2-0489d3db69ac tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1751 microversion: 2.20 time: 0.351980 Aug 24 14:49:08.136186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 396/799] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:07 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:08.784709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1822064546", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5895cdf-b3b8-44b7-8473-a928f868e86e"}], "security_groups": [{"name": "tempest-securitygroup--254067514"}], "key_name": "tempest-keypair-2134492380", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:08.896471 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] validate_networks() for [('e5895cdf-b3b8-44b7-8473-a928f868e86e', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:49:09.098106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:09.098763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:09.105404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.105895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.106334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.107128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.107583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.108008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.135500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:49:09.237425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c06e3300-c5ce-4dd6-84eb-6c90a8243784 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 204 len: 0 microversion: 2.1 time: 0.143009 Aug 24 14:49:09.240166 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 397/800] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:49:09 2022] DELETE /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:49:09.247482 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:09.248722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:09.258086 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.258601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.259033 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.259764 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.260235 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.260733 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.330999 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:49:09.331413 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:49:09.331916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:49:09.332293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:49:09.332872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:49:09.343045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.343426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.343857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.344591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.345033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.345437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.363332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:09.367610 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:09.380043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:49:09.382647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:49:09.439970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:09.446335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0c3a23d8-082a-498b-80c9-9745300066e2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667559 Aug 24 14:49:09.447421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 404/801] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:49:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:49:09.453346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:09.454465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:09.465305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.465593 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:09.466097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.466823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.467971 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.468453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:09.468696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.469396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.471547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c03c0903-f73d-40b7-a760-e8c96bf5e391 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1753 microversion: 2.20 time: 0.231114 Aug 24 14:49:09.472763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 398/802] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:09 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:09.479337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3fc9efb3-967c-4c08-990e-106b190687e1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:09.479944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3fc9efb3-967c-4c08-990e-106b190687e1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:09.560150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3fc9efb3-967c-4c08-990e-106b190687e1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:09.567849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3fc9efb3-967c-4c08-990e-106b190687e1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1242 microversion: 2.1 time: 0.093176 Aug 24 14:49:09.568527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 399/803] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:09 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:09.628930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:09.631256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:09.638680 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7ce239e6-fc07-434e-986e-8c258324e886 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1553 microversion: 2.1 time: 0.189620 Aug 24 14:49:09.639288 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 405/804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:09 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:10.501535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:10.502144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:10.509584 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.510072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.510488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.511243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.511674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.512093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.592653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:10.593409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:10.604793 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.605362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.605936 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.606537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.606975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.607384 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.660773 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:10.670818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:10.672310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:10.673486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7528ed75-d1be-4c5a-8c43-ed42100f38bd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1753 microversion: 2.20 time: 0.176269 Aug 24 14:49:10.674062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 400/805] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:10 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:10.679106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:10.679706 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:10.680617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:10.687500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.688251 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.688674 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.689361 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:10.689799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:10.690212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.691437 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cadcbacd-2855-487f-bb74-65b854d5803b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1246 microversion: 2.1 time: 0.102990 Aug 24 14:49:10.692125 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 406/806] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:10 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:10.836835 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:10.846307 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bbeb5368-2448-475e-bc9f-2c653fb4e896 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1553 microversion: 2.1 time: 0.171196 Aug 24 14:49:10.846935 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 401/807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:10 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:10.946778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:49:10.947074 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Wed Aug 24 14:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:49:11.703741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:11.704839 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:11.716129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.716661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.717089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.718042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.718504 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.718887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.723142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:11.723758 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:11.731160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.731631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.732114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.732831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.733273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.733708 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.803777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:11.811998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-441b5563-c143-4af1-bc9c-c8824d6c1432 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1294 microversion: 2.1 time: 0.095539 Aug 24 14:49:11.812586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 402/808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:11 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:11.869352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:11.869958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:11.876402 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.877009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.877467 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.878214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:11.878701 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:11.879144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:11.882166 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:11.897703 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:11.900687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:11.902444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cba25298-6d33-4dc6-b204-b85886529214 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.205656 Aug 24 14:49:11.903046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 407/809] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:11 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:12.109267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:12.117969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-216414ed-80af-496c-99a9-4506ca19cf7e tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1553 microversion: 2.1 time: 0.252767 Aug 24 14:49:12.118565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 403/810] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:11 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:12.839841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:12.840525 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:12.847387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:12.848136 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:12.848645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:12.849246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:12.849694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:12.850101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:12.877934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99542e48-7ecb-4e78-91c7-e062a63248ff", "name": "network-vif-deleted", "tag": "db60cdcb-2cef-4c75-b557-4483f80e293e"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:12.891388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:12.892276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:12.893094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:12.911698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] Creating event network-vif-deleted:db60cdcb-2cef-4c75-b557-4483f80e293e for instance 99542e48-7ecb-4e78-91c7-e062a63248ff on hv-cinder-84889 Aug 24 14:49:12.918176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-01ec15a4-ccf5-455f-9fc6-4fc1e3629d11 req-ff136314-6ab9-49c1-8f69-267283abbba0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049077 Aug 24 14:49:12.919550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 404/811] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:12.938488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:12.939506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:12.940304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:12.947688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:12.948609 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:12.949141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:12.950039 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:12.950936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:12.951529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:12.956379 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f4ebff3e-d9ad-458a-b39b-03d7da195f54 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1300 microversion: 2.1 time: 0.120228 Aug 24 14:49:12.957645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 408/812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:12 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:13.139922 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:13.141467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:13.149749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:13.151132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:13.151816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:13.152743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:13.153435 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:13.154124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:13.199010 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:13.199901 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:13.200592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:13.201542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lazy-loading 'fault' on Instance uuid 99542e48-7ecb-4e78-91c7-e062a63248ff {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:13.215604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:13.225497 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:13.227095 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:13.231910 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-739e1313-5d6c-4747-8467-d5b2452a481d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.303089 Aug 24 14:49:13.247852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 405/813] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:12 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:13.280066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9240ad6e51074a7a9d4f6338dbce7254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95acd5e8956e411dbb929970259a5b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:13.289913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7f145e90-6cb9-4554-963c-37557692eb1c tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 200 len: 1348 microversion: 2.1 time: 0.154371 Aug 24 14:49:13.304401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 409/814] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:13 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 1348 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:13.981160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:13.983176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:13.989042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:13.989616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:13.990348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:13.991080 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:13.991537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:13.991959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.159786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:14.168359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b81b413d-640f-4fd5-8338-6d480caab947 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.191699 Aug 24 14:49:14.168940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 406/815] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:13 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:14.174732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80911f96-9e7c-4505-a15b-826a576bf0b8", "tag": "082587f2-9b22-485c-aab9-43d688ad70a0"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:14.184518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:14.185018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:14.185478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.199608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] Creating event network-changed:082587f2-9b22-485c-aab9-43d688ad70a0 for instance 80911f96-9e7c-4505-a15b-826a576bf0b8 on hv-cinder-84889 Aug 24 14:49:14.204935 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-1285829d-2d49-482e-8089-ded651ee0a0a req-6b406732-b98d-4f16-b66d-62f5e1fb7941 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037862 Aug 24 14:49:14.205902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 410/816] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:14.256827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:14.257537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:14.264621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:14.265193 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:14.266050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.266852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:14.267363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:14.267960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.319429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:14.321812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] [instance: 99542e48-7ecb-4e78-91c7-e062a63248ff] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:14.330910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:14.331751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:14.332980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.333944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:14.334566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:14.335252 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:14.365311 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] HTTP exception thrown: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Request method failure captured: Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff HTTP/1.1 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjmra0sHxoBxVrBQ1ZboIQSoTVXHM8J-kZpENxW1mdRSkwD0G91ieKnflfT12JOyrxMStBmUATHDNTo-nh1IVJnIES9Ye_l27Z5L7XVQ4eqMA5P8jk12DgnNXL3w1P-pe5plc7rgFki0dn7lvAdsZ-quRDIc1pb1O-BgB-yQAQDLh4Y Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 95acd5e8956e411dbb929970259a5b04 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:49:14.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_95acd5e8956e411dbb929970259a5b04", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/95acd5e8956e411dbb929970259a5b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 95acd5e8956e411dbb929970259a5b04 Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1971651164 Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-TestMinimumBasicScenario-1971651164-project Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 9240ad6e51074a7a9d4f6338dbce7254 Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-TestMinimumBasicScenario-1971651164-project Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. Aug 24 14:49:14.369693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '99542e48-7ecb-4e78-91c7-e062a63248ff'} Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:14.370589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. Aug 24 14:49:14.372042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:14.375827 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Returning 404 to user: Instance 99542e48-7ecb-4e78-91c7-e062a63248ff could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:14.398950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-78b86e30-0170-433c-8013-17733d2403b8 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff" status: 404 len: 111 microversion: 2.1 time: 0.068962 Aug 24 14:49:14.404357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 411/817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:14 2022] GET /compute/v2.1/servers/99542e48-7ecb-4e78-91c7-e062a63248ff => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:49:14.411966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b367da22-1d45-4ffc-ae36-ceecad116da4 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] Calling method '.version_select at 0x7f87499b8b80>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:14.447406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b367da22-1d45-4ffc-ae36-ceecad116da4 tempest-TestMinimumBasicScenario-1971651164 tempest-TestMinimumBasicScenario-1971651164-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1597281825" status: 202 len: 0 microversion: 2.1 time: 0.040985 Aug 24 14:49:14.448333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 412/818] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Aug 24 14:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1597281825 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:14.525163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:14.536905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:14.538647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:14.539911 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ff42497f-71dd-4c71-a326-039192ecc2cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.288029 Aug 24 14:49:14.560522 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 407/819] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:14 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:15.195867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:15.198184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:15.211544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:15.212586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:15.213433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:15.214862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:15.215657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:15.216418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:15.457443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:15.465782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e9784191-5e98-46cc-ad7c-1ea6f4c19d55 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.278298 Aug 24 14:49:15.466926 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 413/820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:15 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:15.568710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:15.570454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:15.578927 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:15.579676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:15.580387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:15.581354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:15.582085 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:15.582803 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:15.817417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:15.832988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:15.836713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:15.839063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cc022681-fec9-4a23-ae72-70339eb758a8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.275486 Aug 24 14:49:15.839707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 408/821] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:15 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:16.488284 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:16.488852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:16.498105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:16.498655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:16.499094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:16.503034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:16.503898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:16.505718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:16.693004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:16.703442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-421084a5-28fc-4775-a7fe-2be5cb495005 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.219051 Aug 24 14:49:16.708960 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 414/822] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:16 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:16.868339 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:16.868955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:16.876072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:16.876905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:16.877559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:16.878549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:16.879219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:16.879863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:17.133997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:17.150376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:17.156104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:17.158106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-55af2caf-64d9-43fa-9097-a72897793c78 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.294906 Aug 24 14:49:17.158996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 409/823] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:16 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:17.734671 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:17.736202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:17.744262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:17.744929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:17.745526 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:17.746422 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:17.747077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:17.748092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:18.033443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:18.048277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-587f3805-3ad0-42a2-8a61-b50e82a7dc9b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.320330 Aug 24 14:49:18.050037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 415/824] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:17 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:18.183321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:18.184808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:18.201363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:18.202143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:18.203023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:18.203902 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:18.204506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:18.205098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:18.473005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:18.474775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:18.499186 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:18.500731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:18.502193 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-060793c4-c1c0-42f0-b0a9-777ac01907ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.324025 Aug 24 14:49:18.503017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 410/825] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:18 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:19.073257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:19.074003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:19.084122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:19.085046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:19.085685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:19.086828 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:19.087673 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:19.088325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:19.351515 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:19.358607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:19.374060 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ded46406-1744-47a7-bc0e-b448c5fc1e92 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.306931 Aug 24 14:49:19.379501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 416/826] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:19 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:19.534330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:19.535108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:19.542709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:19.543200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:19.543859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:19.544799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:19.545521 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:19.546128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:19.586443 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:19.974220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:19.986825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:19.988676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:19.990227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b1f3951-f80a-4ef4-8e4a-5c78abdf060f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.464596 Aug 24 14:49:20.002845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 411/827] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:19 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:20.403464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:20.404739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:20.410615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=10 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:20.413679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:20.414398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:20.415043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:20.415916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:20.416526 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:20.417113 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:20.667932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:20.677492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6c100c65-25b6-43c3-9f0a-e03d4e82b171 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.277297 Aug 24 14:49:20.678753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 417/828] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:20 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:21.022170 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:21.023346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:21.030118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.030766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.031468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:21.032412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.033548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.034188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:21.383419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:21.399978 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:21.404907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:21.406351 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d489eefb-076d-4daa-ba5e-ed7dd3ac3392 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.388731 Aug 24 14:49:21.418548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 412/829] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:21 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:21.699528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:21.700169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:21.702744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:21.709538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.710574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.711242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:21.712200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.712941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.713701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:21.955658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:21.963371 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7a2650b9-9412-4bed-b03a-3a3945541ba6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.267692 Aug 24 14:49:21.963907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 418/830] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:21 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:22.435822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:22.436550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:22.444422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.456493 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.457214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.458273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.459462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.460212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.615131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:22.626577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:22.629216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:22.630970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-062150ad-beca-4200-812c-b4712fd49698 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.199809 Aug 24 14:49:22.632386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 413/831] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:22 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:22.983910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:22.984547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:22.991208 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.991685 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.992118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.992803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.993246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.993665 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:23.452351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:23.463512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f18e42b5-ed79-4e09-9a32-ee7832047396 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.483427 Aug 24 14:49:23.464391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 419/832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:22 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:23.655585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:23.656266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:23.663391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:23.663878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:23.664510 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:23.665220 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:23.665854 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:23.666277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.104128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:24.119352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:24.121281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:24.123514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c703c4eb-2941-40eb-81bf-3d54c7e5aecc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.471754 Aug 24 14:49:24.125084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 414/833] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:23 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:24.485103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:24.486034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:24.493395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.494254 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.494942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.495878 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.496539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.497171 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.725682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:24.733997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3b8d6a6e-b445-473f-a02b-5df9b2fa4044 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.252645 Aug 24 14:49:24.734587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 420/834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:24 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:24.893837 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:24.895017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:24.902931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:24.922343 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.923321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.925364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.926275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.927021 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.927688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.928116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.929532 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.930190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.963110 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] Creating event network-changed:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:49:24.970902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-9c14bc70-cd9e-4421-95f8-e223a77dfa9c req-e4940fc7-2056-4830-acf8-c307d8882f82 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072847 Aug 24 14:49:24.973318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 421/835] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:24.983241 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:49:25.115409 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b924d110-745f-4e90-97d6-dfa4ecfd3ee3 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "DELETE /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 204 len: 0 microversion: 2.1 time: 0.227059 Aug 24 14:49:25.116057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 415/836] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:49:24 2022] DELETE /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:49:25.125919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:25.126762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:25.138726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.140242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.142789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.146577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.147337 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.147849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.149093 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:25.149975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:25.164979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.166133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.167403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.171147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.171628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.172056 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.380767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.391474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.393337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.394710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95e95e18-6b39-4cce-9e6f-d010155cda50 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.250510 Aug 24 14:49:25.395395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 416/837] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:25 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:25.396420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.407846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2bd3898d-37b0-447f-bd7c-2a16730cd370 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.286842 Aug 24 14:49:25.410300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 422/838] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:25 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:25.757872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:25.758812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:25.767315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.768110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.768537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.769211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.769813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.770386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.951850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.975423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3ad2af43-2d48-4d7e-b9ec-4e8a1518de33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.222909 Aug 24 14:49:25.976012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 417/839] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:25 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:26.419487 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:26.420123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:26.426981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.427461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.427889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.428552 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.429005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.429443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.432237 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:26.432849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:26.439303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.439796 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.440506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.441336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.441903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.442263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.586211 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.595921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.597387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.608016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e4f432de-ece6-4a1e-bd43-fa44041ada2d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.193709 Aug 24 14:49:26.608628 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 423/840] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:26 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:26.646393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.657468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-73538bb6-b09c-49af-a746-bfe588ee5bf2 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1570 microversion: 2.1 time: 0.229084 Aug 24 14:49:26.658312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 418/841] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:26 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:26.999120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:26.999852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:27.007540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.008053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.008476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.009206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.009744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.010195 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.238054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.248358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5eebcfb2-6ca2-49e1-a8d0-4512c0abd905 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.253169 Aug 24 14:49:27.249378 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 424/842] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:26 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:27.632729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:27.632729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:27.640600 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.641478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.641920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.642664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.643124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.643540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.683261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:27.684886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:27.692528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.693035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.693465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.694502 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.694979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.695396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.700143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.771726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.780217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e2a1d517-8434-475f-8155-0c330a087212 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1383 microversion: 2.1 time: 0.103303 Aug 24 14:49:27.780772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 425/843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:27 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1383 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:27.785577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505f9752-9301-4986-87d7-d9541817e046", "name": "network-vif-deleted", "tag": "ce030815-38de-4871-b647-4690827e8c13"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:27.796687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.797469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.797903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.804441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.811431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] Creating event network-vif-deleted:ce030815-38de-4871-b647-4690827e8c13 for instance 505f9752-9301-4986-87d7-d9541817e046 on hv-cinder-84889 Aug 24 14:49:27.813905 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.815559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.822867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-3dcf653b-164d-4f8d-8c43-a43cb8a6d366 req-a17a4edc-3634-4d17-bed1-19eae3854bb6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Aug 24 14:49:27.823690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ae696934-546c-46ef-bd68-e9f8fa0c8e27 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.189554 Aug 24 14:49:27.823795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 426/844] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:27.823898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 419/845] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:27 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:28.271365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:28.272061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:28.279079 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.279556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.279978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.280670 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.281113 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.281523 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.425976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:28.435824 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a82ae911-fb90-4771-8e98-c714b7598ec0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.169569 Aug 24 14:49:28.436772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 427/846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:28 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:28.804378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:28.804960 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:28.812643 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.813221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.813725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.814490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.814984 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.815391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.840256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:28.841476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:28.848600 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.849199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.849684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.850486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.851182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.851801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.890032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e646bfca226747cc8c6ae44371008317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14444d5dc04d1a80d159f6ca0a64db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:28.899425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0815dd32-731f-4633-ab88-3fa0b645dfef tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 200 len: 1220 microversion: 2.1 time: 0.099717 Aug 24 14:49:28.899998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 420/847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:28 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:28.907145 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80911f96-9e7c-4505-a15b-826a576bf0b8", "name": "network-vif-plugged", "status": "completed", "tag": "082587f2-9b22-485c-aab9-43d688ad70a0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:28.919229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.919721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.920130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.932112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] Creating event network-vif-plugged:082587f2-9b22-485c-aab9-43d688ad70a0 for instance 80911f96-9e7c-4505-a15b-826a576bf0b8 on hv-cinder-84889 Aug 24 14:49:28.938845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-4328ee4e-b5d2-4f18-863b-e7b8b424c9dc req-8e0e82a0-ccb4-4dc8-aafb-4b17c1ae5d0d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037044 Aug 24 14:49:28.940165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 421/848] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:29.022902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:29.033528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:29.035041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:29.036595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c6856578-6cc9-4dba-bbec-426b92c14b8b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.200899 Aug 24 14:49:29.037377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 428/849] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:28 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:29.462641 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:29.464357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:29.472577 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.473285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.474013 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.475049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.476549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.476549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.615412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:29.623940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-90363359-bb2b-4e6d-bcda-f5ce1bfdc585 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.166549 Aug 24 14:49:29.624516 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 422/850] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:29 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:29.919483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:29.920160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] [instance: 505f9752-9301-4986-87d7-d9541817e046] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:29.927121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.927607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.928039 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.928727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.929190 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.929608 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.943998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] HTTP exception thrown: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Request method failure captured: Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 HTTP/1.1 Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjkzUNsX1_UTMaFdpK69D4NMPlGo_2eqShakxkZftT7G5ZrY60wovbtfOR85p4k9343VoVi7zmy1NE8XQCYTgJpgurIHqU6gM0r2wsWbnY7SuRAmb03S3oonKO7i2P5v3VvHaIS_2V_NrZb9P9O74nb1FVOqTumqvnlIDjPmPP5nYoA Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 8c14444d5dc04d1a80d159f6ca0a64db Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-TestShelveInstance-1854660026 Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:49:29.945800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8c14444d5dc04d1a80d159f6ca0a64db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8c14444d5dc04d1a80d159f6ca0a64db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8c14444d5dc04d1a80d159f6ca0a64db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8c14444d5dc04d1a80d159f6ca0a64db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-TestShelveInstance-1854660026 Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 8c14444d5dc04d1a80d159f6ca0a64db Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-TestShelveInstance-1854660026 Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-TestShelveInstance-1854660026-project Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: e646bfca226747cc8c6ae44371008317 Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-TestShelveInstance-1854660026-project Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. Aug 24 14:49:29.947349 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '505f9752-9301-4986-87d7-d9541817e046'} Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:29.948170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. Aug 24 14:49:29.949684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:49:29.951299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Returning 404 to user: Instance 505f9752-9301-4986-87d7-d9541817e046 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:29.951299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e3a5b96b-5feb-4e25-b00c-f479ad56c7ab tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 24 14:49:29.951299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 429/851] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:29 2022] GET /compute/v2.1/servers/505f9752-9301-4986-87d7-d9541817e046 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:30.060772 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.061387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:30.068151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.068659 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.069109 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.069877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.070291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.070894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.132697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2ebd5f16-12ca-4e60-a3cc-b45e62cab493 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] Calling method '.version_select at 0x7f874993da60>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.171103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2ebd5f16-12ca-4e60-a3cc-b45e62cab493 tempest-TestShelveInstance-1854660026 tempest-TestShelveInstance-1854660026-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919046976" status: 202 len: 0 microversion: 2.1 time: 0.043452 Aug 24 14:49:30.171899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 430/852] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Aug 24 14:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919046976 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:49:30.215006 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.224213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.225851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.227872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-253407f8-d361-45c8-8d56-48a4e486c1b0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.170317 Aug 24 14:49:30.227872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 423/853] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:30 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:30.646124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.646844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:30.655161 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.655883 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.656582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.657723 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.658409 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.658893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.925478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.937645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7f5c0655-bf0e-4a47-84ca-af31d7767b93 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1367 microversion: 2.1 time: 0.295903 Aug 24 14:49:30.938244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 431/854] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:30 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:31.252438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:31.253195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:31.259421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:31.261347 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.262281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.262994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.263886 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.264509 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.265089 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.432868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:31.443379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:31.445164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:31.446809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9b1bd2d6-d57c-4c23-9e03-f0a32235d032 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.199290 Aug 24 14:49:31.447483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 424/855] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:31 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:31.959076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:31.959801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:31.966851 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.967353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.967788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.968498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.968960 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.969381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.389157 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.397796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fb4b0946-2670-40e6-90c6-36b972e19fe2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1556 microversion: 2.1 time: 0.442612 Aug 24 14:49:32.405272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 432/856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:31 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1556 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:32.419165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:32.419690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:32.426131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.426857 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.427462 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.428167 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.429184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.429184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.470033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:32.470711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:32.477861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.478362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.478823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.479519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.479969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.480391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.571364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-676c6cc1-13ee-457f-a6f4-b181344140d3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155915 Aug 24 14:49:32.572097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 425/857] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:49:32 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:32.632840 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.642224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.643732 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.644906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ea66b2ae-6b23-46f9-9d8f-9937f519f0ca tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.179090 Aug 24 14:49:32.645459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 433/858] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:32 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:32.867320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "name": "network-vif-plugged", "status": "completed", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:32.879518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.880388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.881036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.902586 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] Creating event network-vif-plugged:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:49:32.911988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-df1092d8-e745-4658-a2b8-8108c68ee927 req-c5a167a0-43f0-4944-a394-cc87d8331fdd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048397 Aug 24 14:49:32.913200 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 426/859] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:33.668907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:33.670079 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:33.678696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.679246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.679654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.680438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.680857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.681278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.827245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.836226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.837705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.838965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b561936a-9355-4d7a-9e24-3881d0f2d181 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.174193 Aug 24 14:49:33.839519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 434/860] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:33 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:34.453348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80911f96-9e7c-4505-a15b-826a576bf0b8", "tag": "082587f2-9b22-485c-aab9-43d688ad70a0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:34.465777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.466779 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.467395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.482302 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] Creating event network-changed:082587f2-9b22-485c-aab9-43d688ad70a0 for instance 80911f96-9e7c-4505-a15b-826a576bf0b8 on hv-cinder-84889 Aug 24 14:49:34.487972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6841e140-9ec7-487d-89d7-34d4652f2673 req-a3d6f64f-4a7d-4366-97b9-810a4124b6cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039537 Aug 24 14:49:34.489488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 427/861] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:34.864852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:34.865598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:34.878022 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.878662 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.879396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.880467 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.880939 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.881398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:35.049767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:35.062570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:35.064317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:35.065706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-23db2187-7c6d-46b3-a91f-fbe161587a51 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.205939 Aug 24 14:49:35.066911 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 435/862] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:34 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:36.096164 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:36.097651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:36.106707 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.107371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.107937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.108819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.109384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.109918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.114398 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:36.354572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.364903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.366368 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.367573 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d8c92b26-e1eb-4980-a1d0-d7e34565731b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1809 microversion: 2.20 time: 0.277743 Aug 24 14:49:36.368105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 428/863] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:36 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:49:37.392424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:37.393029 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:37.399746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.400315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.400843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.401636 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.402050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.402700 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.649330 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:37.659356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:37.660858 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:37.662537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c7124cc6-6923-4599-a68b-a90a96fc6bc3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1796 microversion: 2.20 time: 0.275060 Aug 24 14:49:37.663160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 436/864] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:37 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1796 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:50:07.659226 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1445341261", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2063152975", "security_groups": [{"name": "tempest-secgroup-smoke-204705932"}], "block_device_mapping_v2": [{"uuid": "a1c85a67-f402-4a3c-aa73-0ea3320415f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29258503-d20d-4638-a36b-45ed3774b302"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:07.671714 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=9 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:07.672356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=5 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:07.787511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] validate_networks() for [('29258503-d20d-4638-a36b-45ed3774b302', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:50:08.504010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:50:08.504414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:50:08.504889 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:50:08.505299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:50:08.505703 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:50:08.516560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:08.517030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:08.517455 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:08.518172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:08.518637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:08.519060 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:08.537635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:50:08.541762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Getting quotas for user ac02340a58d14a91858b7741772460f6 and project 9aeb3927a2464f7fb5b0c7f8b5b70b83. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:50:08.615907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:50:08.618409 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1c85a67-f402-4a3c-aa73-0ea3320415f0',volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:50:08.776731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-78f5b75b-b2d8-4ed8-9ffb-57b4823163cf tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.126677 Aug 24 14:50:08.777478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 429/865] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:50:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:50:08.790312 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-22dd2a84-29aa-4fdf-9f70-6efcde976d57 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:08.790942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-22dd2a84-29aa-4fdf-9f70-6efcde976d57 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:08.793219 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:08.793970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=57 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:08.868316 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-22dd2a84-29aa-4fdf-9f70-6efcde976d57 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:08.876204 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-22dd2a84-29aa-4fdf-9f70-6efcde976d57 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1095 microversion: 2.1 time: 0.090814 Aug 24 14:50:08.877034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 437/866] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:08 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:09.898673 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:09.899464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:09.910005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:09.910790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:09.911250 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:09.911669 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:09.912124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:09.912580 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:09.994721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:10.008867 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1d2b1148-98ae-44ac-8148-593ee68daa1e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1201 microversion: 2.1 time: 0.115622 Aug 24 14:50:10.009419 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 430/867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:09 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:11.033218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:11.033894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:11.044483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:11.045566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:11.046051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:11.046788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:11.047424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:11.048034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:11.289867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:11.300193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9706b6cb-8155-4a23-b267-016d80766e49 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1278 microversion: 2.1 time: 0.272847 Aug 24 14:50:11.310563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 438/868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:11 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:11.620983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:11.632568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:11.633349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:11.634210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:11.649538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] Creating event network-changed:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:50:11.654968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-99d5efdf-18f9-41cb-a97d-e5c3f93fb2e8 req-b482cb5a-876f-43b2-8ebd-5dabf2cc5df4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037576 Aug 24 14:50:11.656030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 431/869] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:12.335146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:12.336009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:12.345460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:12.345994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:12.346423 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:12.347180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:12.347683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:12.348120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:12.495662 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:12.508462 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b24f3c9c-9c74-4938-8dc6-691404cef646 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.177788 Aug 24 14:50:12.509481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 439/870] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:12 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:13.541319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:13.542013 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:13.549378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:13.549895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:13.550323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:13.551059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:13.551505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:13.551918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:13.701378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:13.709784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-56207cab-3878-495b-b76c-ae5b84322df0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.173165 Aug 24 14:50:13.710446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 432/871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:13 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:14.733050 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:14.733811 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:14.742239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:14.742757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:14.743242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:14.744283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:14.744946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:14.745452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:14.899641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:14.909817 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dc4b0d59-4f5b-40a0-8bf4-8e49f0ac83fa tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.181874 Aug 24 14:50:14.910396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 440/872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:14 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:15.933044 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:15.933793 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:15.941904 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:15.942388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:15.942850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:15.943547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:15.944108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:15.944531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.096374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:16.104435 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2a0b5d12-0c41-4007-91ec-c3d05f32c55f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.175262 Aug 24 14:50:16.105050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 433/873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:15 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:16.158829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:16.159397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:16.166132 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.166645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.167196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.168240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.168686 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.169278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.206500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-15d7534c-8abb-460e-9064-a91b38c8af26 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments/f1f0c72c-4da3-4926-80cb-a7858fef029b" status: 200 len: 194 microversion: 2.20 time: 0.052170 Aug 24 14:50:16.207661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 441/874] 10.222.0.90 () {60 vars in 1454 bytes} [Wed Aug 24 14:50:16 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments/f1f0c72c-4da3-4926-80cb-a7858fef029b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:50:16.291030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:16.291514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:16.299288 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.299798 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.300247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.301021 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.301595 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.302240 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.400699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lazy-loading 'services' on Instance uuid 95c28cb3-2878-47e2-97a0-c8534823a20a {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:16.494786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8dbb9db9-0866-4988-ae57-8d0f0dfdb20e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments/f1f0c72c-4da3-4926-80cb-a7858fef029b" status: 202 len: 0 microversion: 2.20 time: 0.207626 Aug 24 14:50:16.495535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 434/875] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Aug 24 14:50:16 2022] DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments/f1f0c72c-4da3-4926-80cb-a7858fef029b => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:50:16.508041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:16.511887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:16.522852 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.523725 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.524387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.526137 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.526941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.527453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.569644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7b8c948a-9f1e-4795-a3b4-68183d75410e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069079 Aug 24 14:50:16.570600 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 442/876] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Aug 24 14:50:16 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:50:17.131073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:17.132395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:17.142569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.143252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.143751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.144457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.144993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.145422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.308998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:17.322146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5b314559-c0cd-450c-a5ec-b4a87089d422 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.199550 Aug 24 14:50:17.322777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 435/877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:17 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:17.582481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:17.584700 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:17.591667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.592110 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.592535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.593275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.593742 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.594143 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.627102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f159e156-1d90-434e-b3e2-1e16ee25a535 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048640 Aug 24 14:50:17.627658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 443/878] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Aug 24 14:50:17 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:17.696105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:17.696634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:17.703484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.704157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.704890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.705933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.706471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.706924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.735245 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:17.823400 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d3764826-0fe2-472b-a6de-4da81690b85f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 204 len: 0 microversion: 2.20 time: 0.130709 Aug 24 14:50:17.823953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 436/879] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Aug 24 14:50:17 2022] DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:50:17.832544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:17.833244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:17.839407 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.839904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.840330 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.841007 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:17.841461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:17.841874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:17.981786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:17.991477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:17.991980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:17.993165 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e205a2c0-ad82-4c28-b021-876c73b0a2e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.164522 Aug 24 14:50:17.993725 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 444/880] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:17 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:18.344863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:18.345564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:18.352498 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.352985 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.353423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.354131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.354583 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.355042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.509020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:18.517956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a61f7e97-85b3-4e88-9072-eb2ee0f82be8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.177413 Aug 24 14:50:18.518538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 437/881] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:18 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:18.624035 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:18.624657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:18.631304 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.631776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.632202 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.632879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.633323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.633727 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.659025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-18077f85-5eb7-4e70-8f21-bdf9731ee758 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.038824 Aug 24 14:50:18.659604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 445/882] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:50:18 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:18.667974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.668760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.673954 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b48278a-ac98-40c2-adae-6d2585c3fd02"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:18.676330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:18.683511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.683975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.684413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.685137 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.685587 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.686011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.778276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/os-volume_attachments HTTP/1.1 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 74 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:50:18.781019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {"volumeAttachment": {"volumeId": "9b48278a-ac98-40c2-adae-6d2585c3fd02"}} Aug 24 14:50:18.782787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'server_id': '80911f96-9e7c-4505-a15b-826a576bf0b8', 'body': {'volumeAttachment': {'volumeId': '9b48278a-ac98-40c2-adae-6d2585c3fd02'}}} Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:18.783578 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:18.785017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 400 to user: Invalid volume: volume 9b48278a-ac98-40c2-adae-6d2585c3fd02 is already attached to instances: a94b0efc-7058-4b0c-a81b-ed4dd135d600 {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d536b095-aa78-495d-8406-268135b8fbb3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114366 Aug 24 14:50:18.786916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 438/883] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:50:18 2022] POST /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:18.791048 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:18.791697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:18.798101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.798602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.799400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.800102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.800579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.801066 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.827979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:18.876360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.918740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8db142fb-3b8d-4341-a838-f96d496e37f0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 204 len: 0 microversion: 2.1 time: 0.130708 Aug 24 14:50:18.918740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 446/884] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:50:18 2022] DELETE /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:50:18.927157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:18.927772 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:18.938767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.939559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.940359 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:18.941168 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:18.941733 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:18.942261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.019276 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:19.019979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:19.026224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:19.026756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:19.027383 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.028534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:19.028534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:19.029046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.087554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:19.095562 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad450fc0-fc9c-4245-8049-4cb05f62c854 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1681 microversion: 2.1 time: 0.172221 Aug 24 14:50:19.096156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 439/885] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:18 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:19.196222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:19.208131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:19.209705 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:19.210941 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-90ae8344-6fdd-4585-b34a-a7fb40472e02 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.197917 Aug 24 14:50:19.211563 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 447/886] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:19 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:19.539539 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:19.540736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:19.547181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:19.547658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:19.548089 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.548794 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:19.549274 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:19.549691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.697330 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:19.705541 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-99d8b872-ca3e-40fe-aed6-f30034a7a6d5 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.170079 Aug 24 14:50:19.706116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 440/887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:19 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:20.118704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:20.119333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:20.126957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.127577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.128018 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.128829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.129233 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.129655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.235876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:20.236463 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:20.243818 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.244273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.244991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.245777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.246224 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.246649 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.291965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:20.305355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-63814dc8-269f-4c22-a714-c72ad1e7d8af tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1681 microversion: 2.1 time: 0.188692 Aug 24 14:50:20.305355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 448/888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:20 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:20.399571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:20.410282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:20.411843 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:20.413045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-335f7444-be5e-499d-b449-bec64adaec19 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.181499 Aug 24 14:50:20.413653 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 441/889] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:20 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:50:20.731999 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:20.732598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:20.739344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.739848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.740273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.740965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.741415 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.741829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.886277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:20.895022 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7b7fa1b4-b217-407f-bd4c-1332d693097a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.167120 Aug 24 14:50:20.895628 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 449/890] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:20 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:21.325389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:21.326312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:21.334131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.334661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.335425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.336269 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.336727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.337147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.436216 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:21.436867 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:21.444493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.444985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.445424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.446139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.446597 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.447043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.489490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.501165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4c4358d6-97a7-46ed-a115-93823b670b2e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1681 microversion: 2.1 time: 0.179672 Aug 24 14:50:21.502069 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 442/891] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:21 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:21.608013 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.617769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.620344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.622402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-062fadc6-fc68-4dcd-92d7-3d199a9bd090 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1724 microversion: 2.20 time: 0.190051 Aug 24 14:50:21.623173 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 450/892] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:21 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:21.918263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:21.919310 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:21.926702 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.927207 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.927635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.928417 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.928868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.929364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.078153 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:22.086208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1581d124-5ed0-4f69-a914-b23f6754f2dc tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.174146 Aug 24 14:50:22.086846 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 443/893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:21 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:22.523892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:22.525794 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:22.532326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.533102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.533528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.534226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.534690 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.535271 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.648130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:22.649540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:22.658324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.659247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.659938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.661212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.661891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.662615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.683751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:22.780102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:22.789221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:22.790737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:22.791920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b47ede65-092e-4e1f-8cc9-4b706616c19f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1656 microversion: 2.20 time: 0.149948 Aug 24 14:50:22.792479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 444/894] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:22 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:23.096007 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.107752 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80911f96-9e7c-4505-a15b-826a576bf0b8", "name": "network-vif-deleted", "tag": "082587f2-9b22-485c-aab9-43d688ad70a0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:23.143365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e7cc5e05-c605-49e4-ac0e-ba23c2c0d52a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 200 len: 1681 microversion: 2.1 time: 0.614910 Aug 24 14:50:23.145235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 451/895] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:22 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 1681 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:23.156017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.157091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.164095 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:23.164502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.175362 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:23.192049 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.195276 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.196078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.197463 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.202594 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.203757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.207786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] Creating event network-vif-deleted:082587f2-9b22-485c-aab9-43d688ad70a0 for instance 80911f96-9e7c-4505-a15b-826a576bf0b8 on hv-cinder-84889 Aug 24 14:50:23.234185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6fca8a7f-4c94-4b72-83c3-ac0abc352d95 req-13e63a7b-9f32-4111-9adb-0c66c9e17d7f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135997 Aug 24 14:50:23.234981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 445/896] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:23.253762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "name": "network-vif-plugged", "status": "completed", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:23.273916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.274762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.275530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.293770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] Creating event network-vif-plugged:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:50:23.307591 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-b0dc5f09-038a-4222-a439-d588d495a846 req-17bb731c-c553-49d4-b562-15910c104abe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071079 Aug 24 14:50:23.310383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 446/897] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:50:23.573568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c28cb3-2878-47e2-97a0-c8534823a20a", "name": "network-vif-deleted", "tag": "e7c19301-5a98-41af-8858-d1d132ac3515"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:23.582215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.584632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.585246 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.585781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.593617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f5c7c21a-0f51-4380-b928-fd02fb259a1f tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.445804 Aug 24 14:50:23.594440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 452/898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:23 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:23.611812 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] Creating event network-vif-deleted:e7c19301-5a98-41af-8858-d1d132ac3515 for instance 95c28cb3-2878-47e2-97a0-c8534823a20a on hv-cinder-84889 Aug 24 14:50:23.617731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a4a10d54-103e-428b-8901-e33342a0f013 req-7c21cc3d-f7ff-434e-a1a2-72a6b55ccf62 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048340 Aug 24 14:50:23.620566 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 447/899] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:50:23.815473 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:23.816426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:23.823924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.824692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.825284 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.826156 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:23.826804 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:23.827517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.832710 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:23.906047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.933581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.948812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.950044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ecbed9e0-fd8c-42bc-9677-a7782efda336 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1366 microversion: 2.20 time: 0.138752 Aug 24 14:50:23.954582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 453/900] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:23 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:24.165610 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:24.166588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:24.173747 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.174247 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.174790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.175502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.176072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.176406 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.191176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 HTTP/1.1 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:50:24.192741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:50:24.194478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '80911f96-9e7c-4505-a15b-826a576bf0b8'} Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:24.195551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:50:24.197176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:24.199651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:24.199651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-501cd4a4-e17c-4d93-a655-2525bc144082 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 404 len: 111 microversion: 2.1 time: 0.033070 Aug 24 14:50:24.203753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4e7e1ec1-1449-472b-9b56-22d58586132b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '.version_select at 0x7f8749853c10>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:24.208333 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 448/901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:24 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:24.228283 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4e7e1ec1-1449-472b-9b56-22d58586132b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134492380" status: 202 len: 0 microversion: 2.1 time: 0.028417 Aug 24 14:50:24.229182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 454/902] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:50:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134492380 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:50:24.619636 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:24.620273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:24.627658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.628388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.628565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.629244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.629696 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.631131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.890457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:24.900872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-40bfd0fa-bfbc-4e5f-974f-b3db1453d336 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1266 microversion: 2.1 time: 0.285097 Aug 24 14:50:24.901816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 449/903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:24 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:24.983963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:24.984649 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:24.997591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.998088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.998544 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.999243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.999687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.000103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.048501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.049027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.049458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.049913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lazy-loading 'fault' on Instance uuid 95c28cb3-2878-47e2-97a0-c8534823a20a {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:25.100084 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.110744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.112281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.113464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3e78619f-0f0e-4c50-994c-a0c10b7c2dbc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 200 len: 1371 microversion: 2.20 time: 0.134156 Aug 24 14:50:25.114047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 455/904] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:24 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:25.174353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:25.175112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:25.181899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.182387 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.182863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.183588 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.183996 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.184415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.279102 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'services' on Instance uuid a94b0efc-7058-4b0c-a81b-ed4dd135d600 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:25.354759 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7a398093-489f-4cb3-88f3-dd7cafc866de tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments/9b48278a-ac98-40c2-adae-6d2585c3fd02" status: 202 len: 0 microversion: 2.1 time: 0.184062 Aug 24 14:50:25.355262 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 450/905] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:50:25 2022] DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments/9b48278a-ac98-40c2-adae-6d2585c3fd02 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:50:25.367305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:25.370405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:25.376478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.376979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.377403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.378158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.378629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.379044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.412123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-720b7517-3f73-42f0-a14c-110eb6c0ff3c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051663 Aug 24 14:50:25.412694 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 456/906] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:50:25 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:25.928246 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:25.929067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:25.936451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.936937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.937360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.938314 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.938810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.939262 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.089143 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:26.097065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-99f06ad5-65bb-47c0-9054-a1b6e8604545 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1454 microversion: 2.1 time: 0.173110 Aug 24 14:50:26.097630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 451/907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:25 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:26.127736 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.128303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:26.136191 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.136844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.137277 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.137975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.138453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.138623 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.138933 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.139138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:26.145859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.146371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.146844 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.147532 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.147979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.148375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.163629 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a HTTP/1.1 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:50:26.165238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:50:26.166979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '95c28cb3-2878-47e2-97a0-c8534823a20a'} Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:26.167957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:50:26.169527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.170814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:26.170814 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7406cbe6-cc70-4be6-b435-81fd1bbfaed1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 404 len: 111 microversion: 2.20 time: 0.032113 Aug 24 14:50:26.171042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 452/908] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:26 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:26.175866 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-22f9240c-145f-4019-84f1-64b45e893fd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '.version_select at 0x7f874996cdc0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.180511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22f9240c-145f-4019-84f1-64b45e893fd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [d7a71e99-3da5-4b45-b813-99980f9f3c78] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 14:50:26.286295 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:26.294371 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3e1dfe16-e0ad-4fa6-9392-d61b91317e99 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1454 microversion: 2.1 time: 0.170557 Aug 24 14:50:26.295041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 457/909] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:26 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:26.425506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.427857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:26.434588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.435098 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.435541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.436247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.436676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.437103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.475224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fa3a2808-0f5b-492f-8a18-bc60443fc9cf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050890 Aug 24 14:50:26.475224 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 458/910] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:50:26 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:27.188370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [None req-22f9240c-145f-4019-84f1-64b45e893fd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [d7a71e99-3da5-4b45-b813-99980f9f3c78] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 57382. Aug 24 14:50:27.207953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-22f9240c-145f-4019-84f1-64b45e893fd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460457661" status: 204 len: 0 microversion: 2.20 time: 1.035764 Aug 24 14:50:27.208572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 453/911] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Aug 24 14:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460457661 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:50:27.485841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:27.489138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:27.497963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.499294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.499823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.500748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.501321 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.501821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.535395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1043bbc8-e551-46c1-9dc3-eca0724421c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053482 Aug 24 14:50:27.536257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 459/912] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:50:27 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:50:27.605631 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:27.606377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:27.614317 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.614829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.615264 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.615966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.616413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.616833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.642663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:27.727547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b929bd89-7278-46fd-bf8b-b00533ecc9dd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 204 len: 0 microversion: 2.1 time: 0.125700 Aug 24 14:50:27.730589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 454/913] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:50:27 2022] DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:50:27.738620 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:27.739542 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:27.747554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.748769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.749299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.750341 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:27.751076 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:27.751708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:27.999818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:28.000202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d3b6c4f-ca18-4464-ba25-d3448df9694a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: .version_select at 0x7f8749a36790>, body: {"keypair": {"name": "tempest-keypair-1969579059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOECqNmDSqw7pU+r3K8YlnlmGPw6HEG6es0ekfHsAddDBRaWNndr6JnT+l/uvEAIvNoqj206f54vji5QhUUZ6OjtuIEvMW+hHs6yfA4L7/E0vSI4MxcpZ2Ge4XwcDM1zeQ=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:28.013843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c1ac83a2-ddb1-4817-ac2e-c310163bb83c tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1681 microversion: 2.1 time: 0.279529 Aug 24 14:50:28.015313 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 460/914] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:27 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:28.033393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-9d3b6c4f-ca18-4464-ba25-d3448df9694a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:50:28.038116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-9d3b6c4f-ca18-4464-ba25-d3448df9694a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for user b0b28db79b1b4a97a26c1df848bc4de5 and project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:50:28.079073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d3b6c4f-ca18-4464-ba25-d3448df9694a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.081362 Aug 24 14:50:28.080255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 455/915] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Aug 24 14:50:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:50:28.083501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:28.094241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:28.094819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:28.095480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:28.110299 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] Creating event network-changed:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:50:28.116118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-bbe05373-6dde-452d-86d1-b8f638243ec0 req-3cf57cc4-77c4-4c80-8d46-3fe5e4dc58a8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037478 Aug 24 14:50:28.117203 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 461/916] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:29.041088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:29.041972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:29.050876 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.051524 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.052055 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.052944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.053536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.057322 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.282136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:29.295152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3a375bd4-ee8b-4c14-988d-eda404992fff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1681 microversion: 2.1 time: 0.261103 Aug 24 14:50:29.296238 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 456/917] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:29 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:29.689265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-170622213", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a2efdad-9d2c-424f-baba-3976626f3ebf"}], "security_groups": [{"name": "tempest-securitygroup--1443950161"}], "key_name": "tempest-keypair-1969579059", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:29.798828 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] validate_networks() for [('2a2efdad-9d2c-424f-baba-3976626f3ebf', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:50:30.317969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:30.318675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:30.325334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.326138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.326579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.327439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.327877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.328549 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.393196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:50:30.393913 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:50:30.395261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:50:30.395683 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:50:30.396104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:50:30.407432 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.407949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.408358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.409071 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.409514 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.409932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.429145 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:50:30.433622 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Getting quotas for user b0b28db79b1b4a97a26c1df848bc4de5 and project 97e9fa5bcdaf445a91ef2229fca7b1c9. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:50:30.444833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:50:30.447284 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:50:30.495214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-c92ecf44-344b-4853-9240-dbbe5e8346c8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.811267 Aug 24 14:50:30.495957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 462/918] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Aug 24 14:50:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 14:50:30.506949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:30.507560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:30.565586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:30.574439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:30.576025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:30.577236 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4dc7a4d2-3b44-438a-9ac0-0ddd7b27518f tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1281 microversion: 2.20 time: 0.074142 Aug 24 14:50:30.577955 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 463/919] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:30 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:30.586216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:30.598557 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-057c0059-71a3-445c-b793-a6e7cc5aabf5 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1681 microversion: 2.1 time: 0.284733 Aug 24 14:50:30.599367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 457/920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:30 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:31.069375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94b0efc-7058-4b0c-a81b-ed4dd135d600", "name": "network-vif-deleted", "tag": "46c20040-507e-43f9-b13a-f22f62fcff44"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:31.080531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.081121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.081646 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.095441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] Creating event network-vif-deleted:46c20040-507e-43f9-b13a-f22f62fcff44 for instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 on hv-cinder-84889 Aug 24 14:50:31.102006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-9c4e5923-ee5e-462a-881e-6854299fa3cf req-4159c219-51c9-4612-8991-d40921b3f0cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036415 Aug 24 14:50:31.103492 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 464/921] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:31.600538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:31.601816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:31.608782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:31.611179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.612068 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.612668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.615439 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.616135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.616753 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.622396 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:31.623153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:31.633315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.633762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.638214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.639570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.642182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.642838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.689737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:31.690483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:31.691109 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:31.691577 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'fault' on Instance uuid a94b0efc-7058-4b0c-a81b-ed4dd135d600 {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:31.711823 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:31.720763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:31.722287 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:31.723448 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3ba0a2e0-286c-44b7-9a82-6c27c436969b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1333 microversion: 2.20 time: 0.127113 Aug 24 14:50:31.724022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 458/922] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:31 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1333 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:31.739997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:31.747443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-30038824-6f62-49e3-bab8-2c0b9885f5ef tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 200 len: 1332 microversion: 2.1 time: 0.130592 Aug 24 14:50:31.748036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 465/923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:31 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:32.746834 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:32.747416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:32.754151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:32.754713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:32.755135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:32.755810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:32.756283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:32.756697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:32.769589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:32.770181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:32.778400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:32.779825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:32.780546 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:32.781384 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:32.782100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:32.783043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:32.799053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 HTTP/1.1 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:50:32.800900 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:50:32.805152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'a94b0efc-7058-4b0c-a81b-ed4dd135d600'} Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:32.806120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:50:32.808343 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:50:32.810164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:32.810164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a4b96b7e-b208-4038-9fd9-dcacf799364f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 404 len: 111 microversion: 2.1 time: 0.037127 Aug 24 14:50:32.810164 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 466/924] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:32 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:32.812452 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9c6675e4-5ab4-4608-8276-54691ca5353a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '.version_select at 0x7f8749854550>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:32.833302 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9c6675e4-5ab4-4608-8276-54691ca5353a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706157381" status: 202 len: 0 microversion: 2.1 time: 0.024583 Aug 24 14:50:32.833906 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 467/925] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706157381 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:50:32.838400 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:32.851257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:32.851257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:32.851612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d373b4b-34c3-4fe5-8091-90e19afb09b7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1339 microversion: 2.20 time: 0.108763 Aug 24 14:50:32.852066 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 459/926] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:32 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:33.532005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f442e2de-bef1-48e0-9dba-92bed72caac1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: .version_select at 0x7f874985a040>, body: {"keypair": {"name": "tempest-keypair-622814459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn8YKXY/NcgxcLfF2OFPxH1ZFsOCirl9Qz5TE4j594GxFFPNR1RNs1V8LoAjJ20dc0B26iOWxfvcYBdLAdTIrPYhlATNbdmJbXPw6v5proln4B9ArlssBRAGqCEX1DBmA=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:33.543178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:33.550356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-f442e2de-bef1-48e0-9dba-92bed72caac1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:50:33.556381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-f442e2de-bef1-48e0-9dba-92bed72caac1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:50:33.579967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f442e2de-bef1-48e0-9dba-92bed72caac1 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053324 Aug 24 14:50:33.580560 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 468/927] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:50:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:33.635268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:33.647364 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:33.648205 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:33.648795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:33.662538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] Creating event network-changed:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:50:33.669002 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-0922dc8b-3e81-475b-b21b-9d6f3259f59a req-714c2082-e4f0-47c1-9253-837a953aa684 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038553 Aug 24 14:50:33.669683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 460/928] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:33.876046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:33.876697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:33.884588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:33.885835 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:33.887286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:33.888172 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:33.888862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:33.889290 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:34.109837 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:34.123178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:34.124809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:34.126057 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a6f13d2d-9d10-4eec-ac58-d8d0d5f347f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.254108 Aug 24 14:50:34.126781 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 469/929] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:33 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:35.072188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-124221630", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5895cdf-b3b8-44b7-8473-a928f868e86e"}], "security_groups": [{"name": "tempest-securitygroup--1799280644"}], "key_name": "tempest-keypair-622814459", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:35.149972 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:35.151251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:35.158547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:35.159094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:35.159497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:35.160186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:35.160809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:35.161223 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:35.232104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] validate_networks() for [('e5895cdf-b3b8-44b7-8473-a928f868e86e', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:50:35.302310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:35.311692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:35.313368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:35.314498 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2134c783-786b-4da8-97b0-7eb971c3715a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.168537 Aug 24 14:50:35.315082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 470/930] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:35 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:35.889257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:50:35.889695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:50:35.890324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:50:35.891286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:50:35.891760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:50:35.902096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:35.902633 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:35.903195 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:35.904127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:35.904713 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:35.905215 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:35.923942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:50:35.928300 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:50:35.940492 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:50:35.942963 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:50:35.988184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fa448ed8-973c-4710-b2f6-932a35a2cd15 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.920772 Aug 24 14:50:35.988792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 461/931] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:50:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:50:35.999731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f8b69568-34fa-4000-adf8-f8fce0d2cf47 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:36.000483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f8b69568-34fa-4000-adf8-f8fce0d2cf47 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:36.053855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f8b69568-34fa-4000-adf8-f8fce0d2cf47 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:36.060924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f8b69568-34fa-4000-adf8-f8fce0d2cf47 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1240 microversion: 2.1 time: 0.065044 Aug 24 14:50:36.061489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 471/932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:35 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:36.342313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:36.342993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:36.349127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:36.349603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:36.350035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:36.350751 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:36.351196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:36.351614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:36.501930 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:36.510699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:36.512180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:36.513297 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f247e9a-dbec-4f11-9fd4-7a4a7fdf61f3 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.175494 Aug 24 14:50:36.513849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 462/933] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:36 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:37.082297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:37.083092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:37.089681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:37.090155 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:37.090615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:37.091303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:37.091745 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:37.092153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:37.189030 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:37.198096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-96e52d0a-ded5-4869-b761-7114c77decc6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1300 microversion: 2.1 time: 0.120493 Aug 24 14:50:37.199375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 472/934] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:37 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:37.535852 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:37.536731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:37.543785 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:37.544263 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:37.544837 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:37.545725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:37.546178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:37.546613 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:38.008097 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:38.017871 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:38.019451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:38.020564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6c43cd57-da3a-4978-8f73-3245f17b1583 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.488968 Aug 24 14:50:38.021061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 463/935] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:37 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:38.226801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:38.227565 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:38.234966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:38.235457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:38.235887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:38.236591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:38.237275 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:38.237809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:38.314531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:38.323133 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6c3c8158-43fc-41be-a5c7-0d1c3bfd6ef0 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1298 microversion: 2.1 time: 0.100497 Aug 24 14:50:38.323850 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 473/936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:38 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:39.044232 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:39.045443 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:39.052956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.053842 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.054381 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.055566 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.056079 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.056531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.089656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1a5820-af28-411e-a24a-dfcfe69568a3", "tag": "368998e1-a26a-480e-bce4-f1c5bd93386f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:39.111249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.111931 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.112734 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.128895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] Creating event network-changed:368998e1-a26a-480e-bce4-f1c5bd93386f for instance ae1a5820-af28-411e-a24a-dfcfe69568a3 on hv-cinder-84889 Aug 24 14:50:39.136405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-b0a02135-fc3e-46ed-b42a-72ed0a89888c req-ca4363e6-95f0-4e19-aafc-11c6ee534a94 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058039 Aug 24 14:50:39.137633 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 474/937] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:39.247402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "name": "network-vif-plugged", "status": "completed", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:39.258997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.259949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.260352 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.276553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:39.278704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] Creating event network-vif-plugged:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:50:39.285310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-0ed110e7-99a2-4909-858e-489f045908a2 req-adf4770d-e713-4dfe-83dc-74b343daf6b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043962 Aug 24 14:50:39.286459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 475/938] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:50:39.287764 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:39.289525 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:39.290951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-73485c87-5896-4e50-8041-54632adc4b94 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.250845 Aug 24 14:50:39.306640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 464/939] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:39 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:39.347893 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:39.348599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:39.356245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.356531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.356968 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.357661 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:39.358297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:39.358944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:39.525499 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:39.532963 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3c8e176c-d64b-484a-aab5-f8d7c9081872 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.189314 Aug 24 14:50:39.533789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 476/940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:39 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:40.315470 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:40.316176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:40.323346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:40.323827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:40.324255 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:40.325106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:40.325687 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:40.325987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:40.345880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:40.476925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:40.486587 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:40.488169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:40.489388 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-caf4d6fb-bda1-4013-84c5-2f2fbc6a0318 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.180546 Aug 24 14:50:40.489970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 465/941] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:40 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:40.554100 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:40.554733 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:40.557272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:40.563043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:40.563524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:40.563921 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:40.564638 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:40.565078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:40.565486 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:40.982146 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:40.991239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-553c6502-3c5f-4934-b18b-97eadac8d027 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.441021 Aug 24 14:50:40.991802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 477/942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:40 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:41.519484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:41.520124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:41.527638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:41.528138 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:41.528571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:41.529294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:41.529742 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:41.530162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:41.749679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:41.758551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:41.760104 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:41.761221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-174c456c-ab52-4fd3-b87f-0ad40ef670cf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1407 microversion: 2.20 time: 0.248299 Aug 24 14:50:41.761815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 466/943] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:41 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:42.011924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:42.012538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:42.019809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.020292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.020724 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.021421 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.021869 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.022292 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.026425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=100 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:42.319775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:42.327571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7966ca94-0d83-4ed7-b07d-db65bb76e42d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.319659 Aug 24 14:50:42.328188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 478/944] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:42 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:42.784026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:42.784825 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:42.791260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.791745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.792175 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.792916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.793626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.794423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.933761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:42.946769 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:42.949529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:42.951677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c77d1a1c-63df-4952-9d37-4e3aa1e2512d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1599 microversion: 2.20 time: 0.171807 Aug 24 14:50:42.952695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 467/945] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:42 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:42.976787 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:42.977270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:42.983232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.983704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.984126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.984927 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.985369 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.985775 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:43.070194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-875b348f-5d21-4cae-b87e-e29c6228f469 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097270 Aug 24 14:50:43.071194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 479/946] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Aug 24 14:50:42 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:50:43.349162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:43.349993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:43.361780 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:43.362644 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:43.363413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:43.364688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:43.365483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:43.366208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:43.544971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:43.554057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-50fae582-eb64-4131-8a74-e3508778f0ed tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.209419 Aug 24 14:50:43.554708 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 468/947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:43 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:44.104981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:44.114912 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:44.115387 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:44.115810 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:44.128400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] Creating event network-changed:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:50:44.133540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-6dc7cb1b-373c-4881-80be-5e99b47b183a req-ddb15cc2-a2f1-4aa8-9480-d4b537b12138 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032792 Aug 24 14:50:44.134815 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 480/948] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:44.575345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:44.575966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:44.582784 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:44.583531 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:44.583962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:44.584677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:44.585285 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:44.585870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:44.821454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:44.831320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1f90bd71-1198-4541-bad8-8fbecb148b0e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.260086 Aug 24 14:50:44.832448 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 469/949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:44 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:45.477082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1a5820-af28-411e-a24a-dfcfe69568a3", "name": "network-vif-plugged", "status": "completed", "tag": "368998e1-a26a-480e-bce4-f1c5bd93386f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:45.489946 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:45.490569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:45.491315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:45.506125 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] Creating event network-vif-plugged:368998e1-a26a-480e-bce4-f1c5bd93386f for instance ae1a5820-af28-411e-a24a-dfcfe69568a3 on hv-cinder-84889 Aug 24 14:50:45.513082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-ac36874a-e50f-4d08-8b77-4503a27f19a1 req-902137ff-2184-429b-82a1-aebe75bca17f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040482 Aug 24 14:50:45.513983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 481/950] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:45.852536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:45.853214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:45.860348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:45.860828 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:45.861258 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:45.862005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:45.862453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:45.862881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:45.912907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:45.935574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=10 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:46.021125 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:46.029771 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-36689135-c383-48aa-ad2c-c2de148877a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.181111 Aug 24 14:50:46.030969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 470/951] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:45 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:47.049106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=14 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:47.054289 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:47.055062 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:47.062041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:47.062681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:47.063124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:47.063823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:47.064298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:47.064711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:47.211708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:47.220028 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-01dc8a3c-7637-4c4d-9b09-57d5fd97d62a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1366 microversion: 2.1 time: 0.171809 Aug 24 14:50:47.220825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 482/952] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:47 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:48.241643 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:48.242379 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:48.249305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.249799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.250275 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.251012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.251465 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.251891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.396324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:48.404061 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-23e9d412-9c70-4afe-9533-fa5192e261fc tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1556 microversion: 2.1 time: 0.166817 Aug 24 14:50:48.404626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 471/953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:48 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:48.424507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:48.425033 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:48.431996 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.432469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.433090 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.433803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.434262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.434721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.512803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-be6c40cf-2301-4379-a0cb-4b5b59529077 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092388 Aug 24 14:50:48.513395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 483/954] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:50:48 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:49.516769 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1a5820-af28-411e-a24a-dfcfe69568a3", "tag": "368998e1-a26a-480e-bce4-f1c5bd93386f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:49.534890 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:49.535554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:49.536239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:49.549858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] Creating event network-changed:368998e1-a26a-480e-bce4-f1c5bd93386f for instance ae1a5820-af28-411e-a24a-dfcfe69568a3 on hv-cinder-84889 Aug 24 14:50:49.557349 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-4293b798-ea7a-4a65-aa9f-af8102c2dd8f req-ebccab93-38bc-4683-b8be-418afe61e866 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048072 Aug 24 14:50:49.557955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 472/955] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:27.436655 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:27.437483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=22 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:27.441998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:27.442607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:27.449982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.450466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.450957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.451648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.452142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.452587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.478257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8993d87e-4fd9-4700-b3ef-387bade26ddf tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/ips" status: 200 len: 150 microversion: 2.1 time: 0.043700 Aug 24 14:51:27.478865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 484/956] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:51:27 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:27.825688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:27.827503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=40 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:27.833638 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:27.834371 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:27.843877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.844511 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.845112 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.846015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.846685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.847252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.884625 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f29d18b5-99d5-4876-9ea7-7b474b4655a9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/ips" status: 200 len: 152 microversion: 2.20 time: 0.060350 Aug 24 14:51:27.885574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 473/957] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Aug 24 14:51:27 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/ips => generated 152 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:51:28.864266 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcad4a1b-9749-4b99-8fb6-d17d1e593c5d"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:28.866682 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:28.873537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.874027 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.874456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:28.875181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.875632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.876053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.295282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3730b346-3015-481c-9509-a9d6cb3de559 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434807 Aug 24 14:51:29.295990 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 485/958] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:51:28 2022] POST /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:29.801403 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:29.802047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:29.809783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.810669 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.811332 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.812229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.812769 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.813228 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.847085 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lazy-loading 'flavor' on Instance uuid c6873ce2-f6f4-4c24-b85d-e88cde554958 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:30.187187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7597552f-a9cd-495e-9db4-180c531d42f1 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/action" status: 202 len: 0 microversion: 2.20 time: 0.389844 Aug 24 14:51:30.187969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 474/959] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Aug 24 14:51:29 2022] POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:51:30.200170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:30.200952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:30.208225 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:30.208716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:30.209150 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:30.209864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:30.210326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:30.210839 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:30.354895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:30.365008 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:30.367230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:30.368801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-45a573f0-e266-4be8-9203-846b5fb6edc4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.173116 Aug 24 14:51:30.369365 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 486/960] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:30 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:31.396149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:31.397239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:31.406621 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.407350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.408103 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.408597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.409049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.409558 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.833895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:31.842289 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:31.843796 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:31.844954 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-132efc15-9819-4f8c-8a77-da2a2ddc980d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.455484 Aug 24 14:51:31.845508 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 475/961] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:31 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:32.873510 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:32.874192 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:32.881965 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.882540 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.882989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.883667 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.884111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.884524 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:33.019388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:33.028005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:33.029585 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:33.030897 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3df19744-2e33-41a5-9c4f-a7af79ed33bf tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.163108 Aug 24 14:51:33.031469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 487/962] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:32 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:34.059099 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:34.060106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:34.067510 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:34.067992 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:34.068424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:34.069113 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:34.069564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:34.069982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:34.212528 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:34.223607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:34.225761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:34.227535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-94d65530-867f-42d5-adf3-5e46f34ce9f4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.174818 Aug 24 14:51:34.228253 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 476/963] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:34 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:35.251260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:35.252096 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:35.258938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.259420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.260065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.260760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.261209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.261632 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.400528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:35.409273 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:35.410812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:35.411980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f63b7584-3a41-43d5-80af-39eea0ea351e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.164801 Aug 24 14:51:35.412539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 488/964] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:35 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:36.440944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:36.441582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:36.448464 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.448945 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.449370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.450053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.450495 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.450917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.585833 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:36.597181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:36.599015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:36.600597 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c9d71259-097a-4601-b5b3-1fa4f5bf1ec6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.163487 Aug 24 14:51:36.601286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 477/965] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:36 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:36.862047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcad4a1b-9749-4b99-8fb6-d17d1e593c5d"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:36.864570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:36.871606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.872088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.872518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.873213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.873699 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.874120 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.963331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: POST /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments HTTP/1.1 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 74 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:51:36.966088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {"volumeAttachment": {"volumeId": "bcad4a1b-9749-4b99-8fb6-d17d1e593c5d"}} Aug 24 14:51:36.968444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'server_id': 'ae1a5820-af28-411e-a24a-dfcfe69568a3', 'body': {'volumeAttachment': {'volumeId': 'bcad4a1b-9749-4b99-8fb6-d17d1e593c5d'}}} Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:51:36.969257 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:36.970501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 400 to user: Invalid volume: volume bcad4a1b-9749-4b99-8fb6-d17d1e593c5d is already attached to instances: ae1a5820-af28-411e-a24a-dfcfe69568a3 {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-227f7715-5868-4b03-b7a2-253c700fc0ff tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110380 Aug 24 14:51:36.971769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 489/966] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:51:36 2022] POST /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:51:37.038811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:37.039404 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:37.048020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.048538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.048974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.049678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.050131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.050620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.145036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'services' on Instance uuid ae1a5820-af28-411e-a24a-dfcfe69568a3 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:37.238301 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fdfcdead-35bf-4711-abfa-b45eef1a0531 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments/bcad4a1b-9749-4b99-8fb6-d17d1e593c5d" status: 202 len: 0 microversion: 2.1 time: 0.205088 Aug 24 14:51:37.238966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 478/967] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:51:37 2022] DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments/bcad4a1b-9749-4b99-8fb6-d17d1e593c5d => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:37.247962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:37.250286 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:37.257712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.258201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.258672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.259359 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.259808 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.260230 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.293019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-36b2a4db-4d30-4dbf-ad93-8651a64d7843 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049024 Aug 24 14:51:37.293592 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 490/968] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:37 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:37.627551 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:37.628163 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:37.635737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.636225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.636655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.637350 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.637802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.638225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.783430 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:37.792076 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:37.793543 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:37.794733 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2e67efb8-66c4-436f-8c8b-c3151e8659eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.172447 Aug 24 14:51:37.795294 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 479/969] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:37 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:38.305833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.308281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.315507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.315964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.316634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.317433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.317919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.318370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.351074 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-44e4146c-559d-4b8d-9f81-b7e009655678 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049329 Aug 24 14:51:38.351678 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 491/970] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:38 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:51:38.415698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.416124 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.422598 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.423107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.423536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.424222 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.424692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.425090 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.450704 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:51:38.530604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1a431d7a-04ae-40cc-b6f4-dab04c100725 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 204 len: 0 microversion: 2.1 time: 0.118342 Aug 24 14:51:38.531092 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 480/971] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:51:38 2022] DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:51:38.539629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.540242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.546800 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.547298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.547731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.548434 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.548874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.549448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.688659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.696832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4e9bcbfe-d829-4da3-b86c-d48f9949c2f8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1681 microversion: 2.1 time: 0.161064 Aug 24 14:51:38.697416 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 492/972] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:38 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:38.821489 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.822094 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.829740 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.830245 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.830718 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.831424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.831845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.832261 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.982872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.992681 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.994161 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.995337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a52c02f8-a509-4240-b3b1-823b45b74d62 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.178590 Aug 24 14:51:38.995863 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 481/973] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:38 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:39.719318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:39.720266 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:39.727213 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.727629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.728195 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.729091 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.729497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.729919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.877456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:39.887812 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-dd390a82-57d0-48a2-ba63-4530f739ad61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1681 microversion: 2.1 time: 0.172556 Aug 24 14:51:39.888641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 493/974] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:39 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:40.087779 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:40.088732 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:40.097249 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:40.097736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:40.098185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:40.098916 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:40.099370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:40.099805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:40.247372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:40.256250 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:40.257881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:40.259188 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-65ac3aec-58bf-43b5-8933-80db1d3a0da0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.244406 Aug 24 14:51:40.259746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 482/975] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:40 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:40.911967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:40.912580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:40.918984 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:40.919477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:40.919905 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:40.920607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:40.921051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:40.921470 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:41.062128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:41.070455 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-320211a1-235c-459a-b61a-441cc3e8a427 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1681 microversion: 2.1 time: 0.162951 Aug 24 14:51:41.071319 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 494/976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:40 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:41.281934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:41.282851 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:41.289923 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:41.290408 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:41.290983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:41.291699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:41.292151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:41.292568 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:41.588797 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:41.597765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:41.599337 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:41.600559 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-abc8deef-b5e2-4542-9b1f-d68c52ebb0ef tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.323094 Aug 24 14:51:41.614567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 483/977] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:41 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:41.657711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1a5820-af28-411e-a24a-dfcfe69568a3", "name": "network-vif-deleted", "tag": "368998e1-a26a-480e-bce4-f1c5bd93386f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:41.673093 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:41.673786 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:41.674234 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:41.692870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] Creating event network-vif-deleted:368998e1-a26a-480e-bce4-f1c5bd93386f for instance ae1a5820-af28-411e-a24a-dfcfe69568a3 on hv-cinder-84889 Aug 24 14:51:41.699458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-5a8fea4c-e50c-46e3-9cbd-641ff3d6a68a req-31d5ad38-7e72-44c4-9db2-591bab522ab9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121259 Aug 24 14:51:41.700104 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 495/978] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:42.093336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:42.094005 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:42.100611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:42.101098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:42.101504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:42.102485 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:42.102975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:42.103416 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:42.138043 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:42.138537 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:42.138971 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:42.139414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'fault' on Instance uuid ae1a5820-af28-411e-a24a-dfcfe69568a3 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:42.186002 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:42.196377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-86913d47-67b5-4fed-b6dd-59d108783241 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 200 len: 1330 microversion: 2.1 time: 0.106914 Aug 24 14:51:42.197389 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 484/979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:42 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:42.628944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:42.629768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:42.636980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:42.637402 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:42.637827 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:42.638532 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:42.638995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:42.639404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:42.786714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:42.795025 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:42.796513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:42.797672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ed41f67e-a467-4a5c-acf7-40b3a07fa1ce tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.173359 Aug 24 14:51:42.798226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 496/980] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:42 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:43.224514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:43.225573 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:43.236011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:43.236500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:43.236933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:43.237632 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:43.238083 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:43.238504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:43.242741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:43.253484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 HTTP/1.1 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:51:43.255239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:51:43.256806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': 'ae1a5820-af28-411e-a24a-dfcfe69568a3'} Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:43.257693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:51:43.259479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:51:43.260918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:43.260918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-29b2265e-aefe-4d13-a335-abd82377b39d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 404 len: 111 microversion: 2.1 time: 0.038858 Aug 24 14:51:43.260918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 485/981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:43 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:43.266009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-66c01c64-945d-4dc4-a0df-1a3bdb91b348 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '.version_select at 0x7f8749853430>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:43.288887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-66c01c64-945d-4dc4-a0df-1a3bdb91b348 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622814459" status: 202 len: 0 microversion: 2.1 time: 0.027052 Aug 24 14:51:43.289481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 497/982] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Aug 24 14:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622814459 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:43.821064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:43.821684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:43.829368 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:43.829867 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:43.830308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:43.831231 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:43.831694 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:43.832116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:43.987916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6e974340-a5e1-469e-9568-cadfd704bd61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: .version_select at 0x7f8749871670>, body: {"keypair": {"name": "tempest-keypair-1471945363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRbsue8d0MWPySQ0nAN/xUI3ht7cPCXPbnMvSDyNk6iwUFWxPx8DldGO25Z6ZXPTpTbhHlO/ryNhtWVgw2cQ/xz0YYN9QjhgsI0nRuWyx4jL9x+eGQLw6N+CrZGp/AEUA=="}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:44.004951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-6e974340-a5e1-469e-9568-cadfd704bd61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:51:44.009056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-6e974340-a5e1-469e-9568-cadfd704bd61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'key_pairs'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:51:44.019772 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:44.028976 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:44.030664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:44.031867 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-40429dab-fdf7-407a-8336-e79d5b63fb66 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.214810 Aug 24 14:51:44.033162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 486/983] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:43 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:51:44.033355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6e974340-a5e1-469e-9568-cadfd704bd61 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051249 Aug 24 14:51:44.033590 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 498/984] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Aug 24 14:51:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:45.055447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:45.056037 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:45.062870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:45.063344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:45.064096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:45.064800 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:45.065260 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:45.065676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:45.262888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:45.272276 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:45.274114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:45.275444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b86e5b9c-c9c8-4f59-bd6e-76b3393b8f36 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.224064 Aug 24 14:51:45.290501 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 487/985] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:45 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:45.410547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180228743", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5895cdf-b3b8-44b7-8473-a928f868e86e"}], "security_groups": [{"name": "tempest-securitygroup--725424789"}], "key_name": "tempest-keypair-1471945363", "user_data": "}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:45.524768 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] validate_networks() for [('e5895cdf-b3b8-44b7-8473-a928f868e86e', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:51:46.054017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:51:46.054489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:51:46.054983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:51:46.055377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:51:46.055774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:51:46.066049 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.066581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.067016 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.067728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.068168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.068581 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.086406 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:51:46.090707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Getting quotas for user 6a99d0b60a1a445ba1c7259e762606f9 and project 78323470ede148b9a51d726b478d0908. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:51:46.108056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:51:46.110588 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:51:46.163505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-21e25a8b-31c9-4c43-bc7c-57ff832c44c7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.757623 Aug 24 14:51:46.164152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 499/986] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:51:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:51:46.175547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c469a4f-2a99-4125-acfb-e63769df0ef6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:46.176226 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8c469a4f-2a99-4125-acfb-e63769df0ef6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:46.232229 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8c469a4f-2a99-4125-acfb-e63769df0ef6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:46.239453 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8c469a4f-2a99-4125-acfb-e63769df0ef6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1241 microversion: 2.1 time: 0.068096 Aug 24 14:51:46.240257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 488/987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:46 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:46.297516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:46.298476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:46.306108 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.306614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.307067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.307816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.308278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.308735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.448324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:46.457458 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:46.459116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:46.460293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a1f701cc-2963-409c-8797-1e07217cf1eb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1745 microversion: 2.20 time: 0.166809 Aug 24 14:51:46.460825 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 500/988] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:46 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:47.262931 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:47.263736 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:47.272494 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.273009 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.273454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.274165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.274664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.275091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.342989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:47.351657 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d7439ec2-40b4-4c18-839c-0faf7f50a3b6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1293 microversion: 2.1 time: 0.092915 Aug 24 14:51:47.352295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 489/989] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:47 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:47.484075 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:47.485507 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:47.507606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.508545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.509256 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.510199 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.510736 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.511315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.682046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:47.693243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:47.695420 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:47.697107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-606b24b0-6c62-4893-ba61-cfb5aaf49741 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1745 microversion: 2.20 time: 0.217314 Aug 24 14:51:47.697673 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 501/990] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:47 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:48.375868 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:48.376486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:48.383781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.384267 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.384716 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:48.385569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.386076 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.386665 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:48.606982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:48.615786 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6c34284b-ad34-40ce-ad18-125d9ded8328 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.244139 Aug 24 14:51:48.616386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 490/991] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:48 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:48.729344 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:48.730772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:48.739659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.740475 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.741255 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:48.742245 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.742894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.744029 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:48.898595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:48.902315 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:48.908153 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:48.909634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:48.911123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-77f7340a-32a1-4b56-97e8-f2e83760f986 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.188207 Aug 24 14:51:48.912159 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 502/992] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:48 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:49.275055 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea82e0d-d784-42ff-8186-d2555fea5b1c", "tag": "bb14434e-dea8-497e-8796-522bf2d3310c"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:49.289444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.290245 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.290603 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.311225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] Creating event network-changed:bb14434e-dea8-497e-8796-522bf2d3310c for instance cea82e0d-d784-42ff-8186-d2555fea5b1c on hv-cinder-84889 Aug 24 14:51:49.316848 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a0db1e5d-c63f-4fb3-9cc1-8b0dac74e0ec req-d39850f5-1db5-4791-9d59-95d15edaed10 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046652 Aug 24 14:51:49.319101 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 491/993] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:49.636789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:49.637651 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:49.647362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.652815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.653602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.654720 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.655410 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.656259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.727139 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "name": "network-vif-plugged", "status": "completed", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:49.744880 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.745494 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.745789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.762589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] Creating event network-vif-plugged:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:51:49.770357 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-2842e964-b453-4842-bd21-1842a0eeba4d req-85862a07-13cb-491f-aceb-e6bee6d4c48e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155411 Aug 24 14:51:49.771629 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 503/994] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:49.942958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:49.944085 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:49.949105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:49.958930 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9518eed-6f66-43ac-a14e-ddfe85ec2577 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.326099 Aug 24 14:51:49.959519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 492/995] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:49 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:51:49.960728 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.961644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.962235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.963165 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:49.963772 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:49.964481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:50.159789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:50.172043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:50.180684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:50.182138 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d8a20098-e348-44ab-89c5-a43309f0738c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.250389 Aug 24 14:51:50.182731 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 504/996] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:49 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:51:50.988342 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:50.989928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:50.998032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:50.998813 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:50.999452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.000385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:51.001030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:51.001414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.207011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:51.208706 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:51.218277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:51.225741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:51.226477 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:51.227094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.227353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c572482f-c61d-4231-b2fd-5219a94101d4 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.246094 Aug 24 14:51:51.228141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:51.228309 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 493/997] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:50 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:51.229086 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:51.229512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.400860 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:51.413008 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:51.413008 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:51.413008 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-61665e5d-4eb9-4910-b00a-36d16e4633bc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.209613 Aug 24 14:51:51.426840 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 505/998] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:51 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:52.248547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:52.249179 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:52.260668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.261428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.262022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:52.262941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.263545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.264120 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:52.436584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:52.438461 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:52.449501 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.450408 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.451839 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:52.452801 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.453483 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.455531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:52.508897 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:52.529959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-28862a2b-f7f2-4687-ab12-404bf201817e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.281780 Aug 24 14:51:52.532165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 494/999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:52 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:52.652932 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:52.662660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:52.665749 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:52.668414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0e41c9a9-5014-4df9-88d1-0e3ba5949f21 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.236856 Aug 24 14:51:52.669519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 506/1000] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:52 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:51:53.553567 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:53.554829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:53.565445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:53.566244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:53.566900 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:53.567776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:53.568474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:53.569129 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:53.701351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:53.702586 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:53.710693 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:53.711428 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:53.712042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:53.712985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:53.713598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:53.714176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:53.809148 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:53.819461 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a23aa38e-eacb-4c59-84a7-ffbb50238cae tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.269630 Aug 24 14:51:53.821088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 495/1001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:53 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:53.910960 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:53.920493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:53.922212 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:53.923770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-bf4155d1-4fdf-453a-bd84-9f1e7155b3ed tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.233661 Aug 24 14:51:53.924456 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 507/1002] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:53 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:54.844196 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:54.844951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:54.851888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.852374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.852822 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:54.853517 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.853950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.854373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:54.947578 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:54.948201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:54.957688 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.958169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.958641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:54.959403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.959903 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.960643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:55.023628 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:55.033144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5c32f7f8-e55d-4f7b-b557-f7899ee678cd tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.195369 Aug 24 14:51:55.035540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 496/1003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:54 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:55.123967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:55.133363 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:55.134872 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:55.136052 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-12850e2e-ccc4-4880-a1ea-7f3913f695e9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.192961 Aug 24 14:51:55.136643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 508/1004] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:54 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:55.653360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea82e0d-d784-42ff-8186-d2555fea5b1c", "name": "network-vif-plugged", "status": "completed", "tag": "bb14434e-dea8-497e-8796-522bf2d3310c"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:55.668669 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:55.670442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:55.670442 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:55.682075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] Creating event network-vif-plugged:bb14434e-dea8-497e-8796-522bf2d3310c for instance cea82e0d-d784-42ff-8186-d2555fea5b1c on hv-cinder-84889 Aug 24 14:51:55.687690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-03efe312-f7ce-42b6-bc07-e2ead9025e4e req-2d8eb897-d0b0-47bf-b7ff-1f5a7a5127d7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038274 Aug 24 14:51:55.688157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 497/1005] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:56.053788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:56.055218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:56.062769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.063333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.063844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.064637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.065167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.065658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.087671 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:56.098595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=10 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:56.160576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:56.161980 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:56.169366 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.169816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.170259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.170987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.171441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.171895 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.246062 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:56.265759 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:56.281148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-7f9c1aca-df0b-4641-91a9-ef9332a2cf03 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.230607 Aug 24 14:51:56.282126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 509/1006] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:56 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:56.366950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:56.376739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:56.378395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:56.379649 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0517551e-ed90-43d1-8bf9-f6a80854d4cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.223524 Aug 24 14:51:56.380214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 498/1007] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:56 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:57.305615 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:57.307666 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:57.318750 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.319318 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.319814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.320584 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.321088 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.321570 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.402885 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:57.403776 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:57.411115 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.411590 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.412067 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.412782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.413236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.413664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.538591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:57.549163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-48bba475-2f21-4e10-961a-7e9f217535a2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1366 microversion: 2.1 time: 0.248052 Aug 24 14:51:57.550425 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 510/1008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:57 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:57.605172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:57.614972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:57.616486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:57.617652 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9bba822-e781-4c03-b6cf-f652977827e0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.218790 Aug 24 14:51:57.622936 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 499/1009] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:57 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:51:58.571433 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:58.572862 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:58.579591 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:58.582713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.583583 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.584541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.585375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.585865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.586373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.640849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:58.641480 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:58.650450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:58.652891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.653370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.653970 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.654804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.655401 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.656095 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.757726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:58.768717 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cfebfd11-bb8a-48ea-b73a-f366e917efd3 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1555 microversion: 2.1 time: 0.202038 Aug 24 14:51:58.785843 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 511/1010] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:58 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:58.794559 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:58.795545 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:58.803206 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.803701 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.804201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.805822 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.806147 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.806707 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.823481 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:58.832887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:58.836158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:58.837429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-35cf96e1-6da7-4cf6-a23f-7cbb5482a5cc tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1740 microversion: 2.20 time: 0.201373 Aug 24 14:51:58.838063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 500/1011] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:58 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:51:58.905681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6418259d-58be-4a04-8623-148aeb3e7e0b tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116506 Aug 24 14:51:58.906499 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 512/1012] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Aug 24 14:51:58 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:59.860278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:59.860908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:59.868010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:59.868525 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:59.868925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:59.869692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:59.870072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:59.870468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:00.160790 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea82e0d-d784-42ff-8186-d2555fea5b1c", "tag": "bb14434e-dea8-497e-8796-522bf2d3310c"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:00.161948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:00.171641 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:00.172478 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:00.172960 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:00.173389 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:00.174373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:00.175944 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8a10f1d2-7669-403a-95b2-9e95718329cb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1722 microversion: 2.20 time: 0.319812 Aug 24 14:52:00.186180 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] Creating event network-changed:bb14434e-dea8-497e-8796-522bf2d3310c for instance cea82e0d-d784-42ff-8186-d2555fea5b1c on hv-cinder-84889 Aug 24 14:52:00.187184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 501/1013] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:51:59 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:00.192579 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-f49479b3-ac42-4f80-929c-c2581a362f48 req-adf53141-af29-4257-81e8-11cd034ae9b0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036816 Aug 24 14:52:00.193366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 513/1014] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:01.201108 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:01.201791 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:01.208913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.209391 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.209827 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.210618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.210997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.211428 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.369921 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:01.378836 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:01.380319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:01.381471 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ba53b633-95d7-49a8-9fd4-12c9d6d35303 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1722 microversion: 2.20 time: 0.184917 Aug 24 14:52:01.382027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 502/1015] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:01 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:02.405737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:02.406440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:02.413697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:02.414191 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:02.414648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:02.415716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:02.415838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:02.416207 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:02.579152 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:02.587816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:02.589300 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:02.590460 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-35234d7c-39f8-4165-b635-e66e1282d8d7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1725 microversion: 2.20 time: 0.189245 Aug 24 14:52:02.591083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 514/1016] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:02 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:02.613989 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecc889b0-7954-478d-a35f-cc153a5dce4f"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:02.618617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:02.624128 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:02.624688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:02.625144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:02.625829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:02.626272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:02.626725 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:02.848165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:02.952948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c88d3a65-0be7-4f40-bc47-fd2f0327cef6 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343146 Aug 24 14:52:02.954345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 503/1017] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Aug 24 14:52:02 2022] POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:52:03.080942 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:03.081354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:03.087539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.088017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.088448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.089131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.089590 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.090006 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.389336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-9fd3c11d-fea5-411a-9dca-7919594ecb01 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments/ecc889b0-7954-478d-a35f-cc153a5dce4f" status: 202 len: 0 microversion: 2.20 time: 0.312534 Aug 24 14:52:03.389949 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 515/1018] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Aug 24 14:52:03 2022] DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments/ecc889b0-7954-478d-a35f-cc153a5dce4f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:03.463185 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:03.463768 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:03.470481 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.471444 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.472142 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.473065 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.473523 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.473950 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.568959 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127297) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:52:03.645348 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aef0dc34-b316-4093-a66b-eb8abccb133e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/action" status: 202 len: 0 microversion: 2.20 time: 0.185952 Aug 24 14:52:03.646056 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 504/1019] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Aug 24 14:52:03 2022] POST /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:03.655005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:03.655676 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:03.667571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.668574 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.669448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.670879 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.671911 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.672803 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.723925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "name": "network-vif-unplugged", "status": "completed", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:03.748808 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:03.749785 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:03.750840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:03.771926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.compute.server_external_events [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] Unable to find a host for instance c6873ce2-f6f4-4c24-b85d-e88cde554958. Dropping event network-vif-unplugged {{(pid=127297) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 14:52:03.773133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-561b12d2-54ad-4a14-832d-95bfff08c4a1 req-87972b2a-7ab0-46ee-93d5-520d1b3b8f4a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055842 Aug 24 14:52:03.774305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 505/1020] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 14:52:03.835991 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:03.844526 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:03.847188 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:03.848418 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e5bcaffc-d91f-4dd5-992c-749391bb7b52 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1673 microversion: 2.20 time: 0.197402 Aug 24 14:52:03.848989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 516/1021] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:03 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:04.872105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:04.872723 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:04.880272 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:04.881479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:04.881479 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:04.882096 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:04.882572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:04.882969 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:05.020392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:05.028945 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:05.030446 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:05.032806 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dfd9acde-a8c4-4891-a0d6-e46afd9c6de0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.164116 Aug 24 14:52:05.033421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 506/1022] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:04 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:05.733788 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:05.734373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:05.748205 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:05.749056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:05.749950 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:05.751247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:05.751936 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:05.752525 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:05.784970 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:52:05.826645 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:05.830067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:05.838376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:05.839292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:05.839913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:05.852457 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] Creating event network-changed:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:52:05.858025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-15fe3e55-3e1a-47f4-9d28-7796f4af17d3 req-582176b5-c16a-41fa-801c-2e7523d62b22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114378 Aug 24 14:52:05.859689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 507/1023] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:05.893790 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-1664efd5-9840-4527-a498-673aa89440e0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "DELETE /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 204 len: 0 microversion: 2.1 time: 0.163521 Aug 24 14:52:05.894771 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 517/1024] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:52:05 2022] DELETE /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:05.904074 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:05.904721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:05.911809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:05.912402 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:05.912904 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:05.913675 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:05.914197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:05.914712 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:06.059598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:06.061618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:06.071614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:06.072106 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:06.072531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:06.073246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:06.073684 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:06.074107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:06.092918 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:06.105149 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3a972b55-9f16-49b9-b637-c35dcf0f5173 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.205817 Aug 24 14:52:06.106942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 508/1025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:05 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:06.222067 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:06.231870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:06.233351 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:06.234905 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-95848bc7-ccbc-4af8-bc9b-a1d3936dbd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.182567 Aug 24 14:52:06.235493 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 518/1026] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:06 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:07.131782 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:07.132382 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:07.139860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:07.140378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:07.141139 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:07.141824 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:07.142429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:07.142877 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:07.262504 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:07.263400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:07.274361 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:07.275281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:07.276089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:07.277664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:07.278244 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:07.279332 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:07.364344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:07.378769 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-07e860f8-1d28-4ac1-9d7f-21c86f8eea80 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.252723 Aug 24 14:52:07.394273 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 509/1027] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:07 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:07.449167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:07.458196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:07.459740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:07.460911 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6fd08d71-091a-4f48-9f9f-d532a1c7cf2e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.205621 Aug 24 14:52:07.461481 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 519/1028] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:07 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:08.401554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:08.402230 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:08.409047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:08.409519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:08.409939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:08.410922 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:08.411376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:08.411792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:08.484755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:08.486200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:08.496951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:08.497777 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:08.498386 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:08.499330 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:08.506183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:08.507111 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:08.620089 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:08.633050 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dac852ad-344a-4c60-99ed-3a51a7a11058 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.235445 Aug 24 14:52:08.634370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 510/1029] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:08 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:08.688249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:08.697981 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:08.699834 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:08.701170 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-697dda8b-0271-433e-95db-765942b09c18 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.221109 Aug 24 14:52:08.701740 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 520/1030] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:08 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:09.662133 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:09.663637 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:09.671018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:09.672021 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:09.672683 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:09.673602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:09.674366 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:09.675014 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:09.726278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:09.726951 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:09.734756 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:09.735398 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:09.735886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:09.736612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:09.737079 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:09.737500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:09.865098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:09.875072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7bed4b60-b3c7-4c14-a315-8ad85ce1656e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.222205 Aug 24 14:52:09.876425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 511/1031] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:09 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:09.924397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:09.933916 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:09.935552 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:09.936806 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6ddde29c-eea4-46d9-933d-2965183f66e8 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.215470 Aug 24 14:52:09.937721 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 521/1032] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:09 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:10.901396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:10.902140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:10.909052 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:10.909540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:10.909965 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:10.919202 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:10.919933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:10.920469 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:10.961681 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:10.963081 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:10.970200 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:10.970716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:10.971148 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:10.971845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:10.972294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:10.972718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:11.094081 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:11.103506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f1e8fe74-f88c-40cc-8c10-155e9d7f43e8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.205924 Aug 24 14:52:11.104106 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 512/1033] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:10 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:11.123548 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:11.132121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:11.133634 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:11.134821 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-98d7d712-c4f0-42de-a323-26b05dec3c0b tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.178033 Aug 24 14:52:11.135376 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 522/1034] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:10 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:11.665356 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "name": "network-vif-unplugged", "status": "completed", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:11.679084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:11.679594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:11.680027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:11.694184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] Creating event network-vif-unplugged:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:52:11.699618 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-b5aa71cb-4333-4614-b747-e7f96fe32672 req-3f253c2e-69b3-47ba-9f33-af21a71af44c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042785 Aug 24 14:52:11.700691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 513/1035] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:12.124887 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:12.125512 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:12.133426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:12.133766 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:12.134267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:12.135119 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:12.135606 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:12.136039 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:12.165548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:12.167344 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:12.176698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:12.177765 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:12.178197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:12.179319 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:12.179627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:12.180049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:12.335637 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:12.344371 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ca4bda12-e333-4015-aeaf-886e82b8c4c0 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.223488 Aug 24 14:52:12.359049 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 523/1036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:12 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:12.366192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:12.375019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:12.376509 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:12.377693 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-66f5a6cd-2f63-4367-b7e4-4b23ea7cd407 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.222012 Aug 24 14:52:12.378329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 514/1037] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:12 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:13.368347 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:13.368973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:13.375687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:13.376169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:13.376601 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:13.377297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:13.377748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:13.378167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:13.404346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:13.405035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:13.412122 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:13.412594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:13.413018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:13.413709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:13.414155 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:13.414690 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:13.601053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:13.610957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:13.615489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fa6711b9-cdc8-45c5-8d96-ab34ccbdaa2d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.250861 Aug 24 14:52:13.616514 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 524/1038] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:13 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:13.633064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:13.634630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:13.635870 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8e6112b5-8779-48b0-bbb9-30ae720e7a13 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.235629 Aug 24 14:52:13.636424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 515/1039] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:13 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:14.636987 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:14.637568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:14.645980 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.646938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.647770 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.649036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.649855 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.650623 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.660018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:14.660860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:14.671412 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.671914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.672355 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.673180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.673727 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.674151 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.838229 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:14.851197 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e95d13e7-d051-4d16-bf65-eddf02786cbe tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.217984 Aug 24 14:52:14.851792 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 525/1040] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:14 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:14.882357 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:14.893706 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:14.895177 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:14.896385 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-62131430-f748-42c8-8a03-d7deec5b1203 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.240603 Aug 24 14:52:14.901291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 516/1041] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:14 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:15.877042 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:15.877982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:15.887692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.888518 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.889219 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:15.890036 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.890790 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.891466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:15.925685 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:15.926582 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:15.933788 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.934365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.934873 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:15.935982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.936663 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.937513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:16.056169 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:16.064479 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5580ec65-49ef-44a3-8091-2bf4eecc0f07 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.192557 Aug 24 14:52:16.065346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 526/1042] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:15 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:16.111735 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:16.120755 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:16.122375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:16.123612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dfb440d0-0a7b-430c-9a89-07dc1f6efcf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.203335 Aug 24 14:52:16.124183 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 517/1043] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:15 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:17.086144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:17.086799 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:17.093955 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.094597 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.095038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.095769 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.096246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.096673 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.147939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:17.148569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:17.156908 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.157512 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.158015 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.158966 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.159529 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.160022 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.253816 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:17.262902 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-483f8ccc-12bc-43bd-aebc-34044314695d tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.180674 Aug 24 14:52:17.263444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 527/1044] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:17 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:17.304590 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:17.310362 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:17.312018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:17.313219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-21303458-ba36-4dca-b50f-7f990dc85153 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.169436 Aug 24 14:52:17.313956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 518/1045] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:17 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:18.285167 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:18.285759 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:18.294663 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.295347 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.295962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.296998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.298270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.298882 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.337839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:18.338933 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:18.347036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.347538 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.347972 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.348700 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.349126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.349545 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.566280 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:18.573809 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:18.583064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:18.584816 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:18.585131 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:18.586010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d51a953e-40f8-4c70-8910-bc1cdabafdde tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.252193 Aug 24 14:52:18.586797 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 519/1046] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:18 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:52:18.595011 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-10210341-a30b-4dc7-97cd-40ba5b91474c tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1578 microversion: 2.1 time: 0.313718 Aug 24 14:52:18.595595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 528/1047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:18 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1578 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:18.877924 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056075a9-cd9b-4436-a672-d3a7882d4202", "name": "network-vif-deleted", "tag": "123e181b-ed61-4c6f-8b1c-8c93f5ba3117"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:18.888496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.888974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.889434 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.902420 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] Creating event network-vif-deleted:123e181b-ed61-4c6f-8b1c-8c93f5ba3117 for instance 056075a9-cd9b-4436-a672-d3a7882d4202 on hv-cinder-84889 Aug 24 14:52:18.907594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a75fd3d8-b103-4b9d-a070-c2b78a706de0 req-28e962b8-4d9e-412d-af5d-ffc1dfaee28f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Aug 24 14:52:18.908213 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 520/1048] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:19.609669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:19.610285 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:19.617197 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:19.617861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.617861 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.618241 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:19.618403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.618920 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.619373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.619798 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.624766 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.625413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.625803 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.626536 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.627010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.627441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.707898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:19.719116 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-64f87cb6-57f8-49b0-aeb9-54011593cbd2 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 200 len: 1226 microversion: 2.1 time: 0.106560 Aug 24 14:52:19.719744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 521/1049] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:19 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:19.794453 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:19.808996 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:19.810537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:19.812037 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3e2815f5-381b-4ec3-8ccd-d15043925491 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.206444 Aug 24 14:52:19.812944 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 529/1050] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:19 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:20.742688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:20.743312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 056075a9-cd9b-4436-a672-d3a7882d4202] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:20.752257 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.753027 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.753770 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.754942 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.755744 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.756376 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.773051 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] HTTP exception thrown: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Request method failure captured: Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 HTTP/1.1 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjlU1P7Y-Oj7FEFn8B9_YyfH25DAkeBYZTEiYHrOdZXgT4uq4kjLMqdYtdI6QuQq-vzDex9EokvZe9PXghfpw3gACi2t_oamLJLtTGWlb7JA9b4BuvNwfxZJ-zamNOr4iWYoZ-VNdt7ZsmcoSRCwrf8QPEUnfd4IVDqkhum5ts0XMrQ Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:52:20.774778 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aeb3927a2464f7fb5b0c7f8b5b70b83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: ac02340a58d14a91858b7741772460f6 Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. Aug 24 14:52:20.776589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '056075a9-cd9b-4436-a672-d3a7882d4202'} Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:20.777527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. Aug 24 14:52:20.779105 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:20.780777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Returning 404 to user: Instance 056075a9-cd9b-4436-a672-d3a7882d4202 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:20.780777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2465ec8f-4615-4070-bd82-4fa818cd3606 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202" status: 404 len: 111 microversion: 2.1 time: 0.038213 Aug 24 14:52:20.780777 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 522/1051] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:20 2022] GET /compute/v2.1/servers/056075a9-cd9b-4436-a672-d3a7882d4202 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:52:20.836249 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:20.836892 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:20.844834 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.845323 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.845748 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.846449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.847048 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.847511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.992780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:21.001210 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:21.003004 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:21.004414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-61b141a0-b7df-4cac-9f81-5319923e5946 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.173131 Aug 24 14:52:21.004997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 530/1052] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:20 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:22.032162 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:22.032768 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:22.046948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:22.047530 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:22.047974 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:22.048695 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:22.049146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:22.049574 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:22.203979 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:22.219746 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:22.222367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:22.224424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0a35370e-b761-474d-974e-b8e75129bac0 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.196823 Aug 24 14:52:22.225321 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 523/1053] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:22 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:23.259714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:23.260298 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:23.267780 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:23.268310 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:23.268805 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:23.269565 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:23.269943 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:23.270371 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:23.477635 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:23.486865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:23.488370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:23.489543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b4cfffe1-9601-4374-b622-11cbf1377936 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.234065 Aug 24 14:52:23.490117 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 531/1054] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:23 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:23.764369 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "name": "network-vif-plugged", "status": "completed", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:23.776123 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:23.776594 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:23.777211 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:23.791914 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] Creating event network-vif-plugged:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:52:23.797450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-03444a44-ed99-4b0a-8520-35fc5fedf8ce req-99c6f573-ea77-4cb7-9118-5c8bdd635899 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037449 Aug 24 14:52:23.798325 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 524/1055] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:52:24.038267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:24.039118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:24.040328 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eca882b-6163-4c18-8d99-313b4bc8a216", "tag": "e4f969e4-4c2a-4a6b-acaa-c919ed6eb681"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:24.050490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.051041 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.051467 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.058246 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.063514 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] Creating event network-changed:e4f969e4-4c2a-4a6b-acaa-c919ed6eb681 for instance 1eca882b-6163-4c18-8d99-313b4bc8a216 on hv-cinder-84889 Aug 24 14:52:24.065978 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.066760 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.067741 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.068489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.069355 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.069670 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-c2d3057d-acdd-472b-8261-5177e56d13a2 req-fba54df3-3289-4510-b833-8c30ee1b3fa8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Aug 24 14:52:24.074810 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 525/1056] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:52:24.101367 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:52:24.139820 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:24.214046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-330a7560-c848-443a-8ba9-9420f1d76691 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 204 len: 0 microversion: 2.1 time: 0.179667 Aug 24 14:52:24.215186 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 532/1057] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:52:24 2022] DELETE /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:24.226117 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:24.226845 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:24.233313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.233858 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.234315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.235266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.235719 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.236141 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.397063 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:24.406495 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-85f4f5c9-8f73-448c-9a49-84f827a6c2da tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1577 microversion: 2.1 time: 0.185100 Aug 24 14:52:24.407139 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 526/1058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:24 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:24.522077 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:24.522832 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:24.529623 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.530121 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.530744 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.531469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.533573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.533573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.675664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:24.684097 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:24.685614 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:24.686871 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-35822f0f-8897-4c38-82d5-7ae54e6bb4a7 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.171310 Aug 24 14:52:24.687434 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 533/1059] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:24 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:25.429136 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:25.429829 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:25.438679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.439189 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.439599 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.440292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.440737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.441181 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.588587 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:25.600156 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d9e9a15f-f66f-4cc4-8a22-063e6942edee tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1577 microversion: 2.1 time: 0.174926 Aug 24 14:52:25.600699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 527/1060] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:25 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:25.710377 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:25.711217 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:25.718554 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.719041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.719468 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.720163 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.720636 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.721064 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.868209 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:25.879080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:25.880582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:25.881746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d51a8d4b-41a0-4caa-ac37-df214d11debb tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.175577 Aug 24 14:52:25.882948 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 534/1061] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:25 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:26.621830 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:26.622554 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:26.630375 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.630910 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.631413 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:26.632345 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.632906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.633370 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:26.800794 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:26.809035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-97d2916e-6b44-4d64-a136-0cf9c046badb tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1577 microversion: 2.1 time: 0.191201 Aug 24 14:52:26.809615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 528/1062] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:26 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:26.907547 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:26.908641 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:26.917814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.918305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.918819 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:26.919782 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.920573 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.921353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:27.084260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:27.093400 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:27.094947 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:27.096142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-cd145f84-8e99-4c39-ad0d-5a3f6b5d71a4 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1731 microversion: 2.20 time: 0.194509 Aug 24 14:52:27.096710 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 535/1063] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:26 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:27.830941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:27.832210 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:27.841091 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:27.841983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:27.842750 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:27.843691 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:27.844313 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:27.844982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.106450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac02340a58d14a91858b7741772460f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeb3927a2464f7fb5b0c7f8b5b70b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:28.140178 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-42bb896e-ba05-45fc-ab8f-ab52eef3cde3 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 200 len: 1459 microversion: 2.1 time: 0.314149 Aug 24 14:52:28.141386 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 529/1064] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:27 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 1459 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:28.142358 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:28.143568 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:28.152353 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:28.153142 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:28.153807 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.154868 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:28.155711 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:28.156612 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.167630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eca882b-6163-4c18-8d99-313b4bc8a216", "name": "network-vif-deleted", "tag": "e4f969e4-4c2a-4a6b-acaa-c919ed6eb681"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:28.177926 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:28.178392 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:28.178838 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.192018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] Creating event network-vif-deleted:e4f969e4-4c2a-4a6b-acaa-c919ed6eb681 for instance 1eca882b-6163-4c18-8d99-313b4bc8a216 on hv-cinder-84889 Aug 24 14:52:28.197010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d89be741-e3ca-4caa-b9b3-be6eeb6bc7d1 req-a8866299-b790-445f-ac0e-981ff966b04a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048408 Aug 24 14:52:28.197622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 530/1065] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:28.318525 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:28.328317 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:28.329877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:28.331271 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-30a220a2-6b89-4915-a9ee-fa3951fdbbf5 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1718 microversion: 2.20 time: 0.215787 Aug 24 14:52:28.331889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 536/1066] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:52:28 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1718 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:52:29.167160 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:29.167859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 1eca882b-6163-4c18-8d99-313b4bc8a216] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:29.169800 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:29.175565 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.176038 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.176477 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.177180 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.177634 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.178058 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.193227 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] HTTP exception thrown: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Request method failure captured: Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 HTTP/1.1 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjlU1P7Y-Oj7FEFn8B9_YyfH25DAkeBYZTEiYHrOdZXgT4uq4kjLMqdYtdI6QuQq-vzDex9EokvZe9PXghfpw3gACi2t_oamLJLtTGWlb7JA9b4BuvNwfxZJ-zamNOr4iWYoZ-VNdt7ZsmcoSRCwrf8QPEUnfd4IVDqkhum5ts0XMrQ Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:52:29.194940 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aeb3927a2464f7fb5b0c7f8b5b70b83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: ac02340a58d14a91858b7741772460f6 Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. Aug 24 14:52:29.196424 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '1eca882b-6163-4c18-8d99-313b4bc8a216'} Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:29.197284 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. Aug 24 14:52:29.198739 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.200020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Returning 404 to user: Instance 1eca882b-6163-4c18-8d99-313b4bc8a216 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:29.200020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8f50f5e2-63ee-4d90-89c5-b6a2dc865a1a tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216" status: 404 len: 111 microversion: 2.1 time: 0.034103 Aug 24 14:52:29.200020 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 531/1067] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:29 2022] GET /compute/v2.1/servers/1eca882b-6163-4c18-8d99-313b4bc8a216 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:52:29.664988 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:29.665535 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:29.668178 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:29.673767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.674266 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.674722 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.675414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.675923 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.676359 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.691380 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] HTTP exception thrown: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Request method failure captured: Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac HTTP/1.1 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjlU1P7Y-Oj7FEFn8B9_YyfH25DAkeBYZTEiYHrOdZXgT4uq4kjLMqdYtdI6QuQq-vzDex9EokvZe9PXghfpw3gACi2t_oamLJLtTGWlb7JA9b4BuvNwfxZJ-zamNOr4iWYoZ-VNdt7ZsmcoSRCwrf8QPEUnfd4IVDqkhum5ts0XMrQ Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:52:29.693103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aeb3927a2464f7fb5b0c7f8b5b70b83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: ac02340a58d14a91858b7741772460f6 Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.694664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '7baf2ec3-7427-4668-8143-7f2e344315ac'} Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:29.695505 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.696973 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.698429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Returning 404 to user: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:29.698429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0ad9046c-0fd5-4b7b-8737-f8eb23efc58e tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 404 len: 111 microversion: 2.1 time: 0.034473 Aug 24 14:52:29.698429 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 537/1068] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:52:29 2022] DELETE /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:52:29.703354 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:29.704073 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] [instance: 7baf2ec3-7427-4668-8143-7f2e344315ac] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:29.710363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.710875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.711305 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.712001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.712445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.712860 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.727486 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] HTTP exception thrown: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Request method failure captured: Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac HTTP/1.1 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjlU1P7Y-Oj7FEFn8B9_YyfH25DAkeBYZTEiYHrOdZXgT4uq4kjLMqdYtdI6QuQq-vzDex9EokvZe9PXghfpw3gACi2t_oamLJLtTGWlb7JA9b4BuvNwfxZJ-zamNOr4iWYoZ-VNdt7ZsmcoSRCwrf8QPEUnfd4IVDqkhum5ts0XMrQ Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:52:29.729036 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aeb3927a2464f7fb5b0c7f8b5b70b83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aeb3927a2464f7fb5b0c7f8b5b70b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 9aeb3927a2464f7fb5b0c7f8b5b70b83 Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-71528761 Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: ac02340a58d14a91858b7741772460f6 Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-71528761-project Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.731277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '7baf2ec3-7427-4668-8143-7f2e344315ac'} Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:29.732589 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. Aug 24 14:52:29.737219 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:52:29.739217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Returning 404 to user: Instance 7baf2ec3-7427-4668-8143-7f2e344315ac could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:29.739217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2722c879-953e-4898-8493-d22de13686b8 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac" status: 404 len: 111 microversion: 2.1 time: 0.030964 Aug 24 14:52:29.739217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 532/1069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:29 2022] GET /compute/v2.1/servers/7baf2ec3-7427-4668-8143-7f2e344315ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:52:31.039997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0c0c077d-f80e-41aa-9aa7-f83eb6e32f96 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] Calling method '.version_select at 0x7f8749a4a1f0>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:31.062763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0c0c077d-f80e-41aa-9aa7-f83eb6e32f96 tempest-TestVolumeBootPattern-71528761 tempest-TestVolumeBootPattern-71528761-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2063152975" status: 202 len: 0 microversion: 2.1 time: 0.027188 Aug 24 14:52:31.067541 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 538/1070] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Aug 24 14:52:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2063152975 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:52:43.593697 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:43.594298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:43.596819 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:43.597476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=50 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:43.603667 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:43.604150 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:43.604585 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:43.605282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:43.605731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:43.606147 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:43.630762 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6182f609-418c-4423-b059-6655a38fb657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/ips" status: 200 len: 148 microversion: 2.1 time: 0.041103 Aug 24 14:52:43.631315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 533/1071] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Aug 24 14:52:43 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:44.989490 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:44.990898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:44.995997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74f102ce-93d2-4ee7-8163-ed3d0e162842"}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:44.998331 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:45.010228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:45.010228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:45.010596 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:45.011029 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:45.011476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:45.011910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:45.317985 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-eddeccf2-38a6-4ba7-88fd-6e749c60d3d7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "POST /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329938 Aug 24 14:52:45.318657 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 539/1072] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Aug 24 14:52:44 2022] POST /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:53.034187 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:53.034864 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:53.041111 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:53.041614 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:53.042076 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:53.042913 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:53.043353 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:53.043767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:53.132323 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'services' on Instance uuid cea82e0d-d784-42ff-8186-d2555fea5b1c {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:52:53.222290 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f704acf4-d81f-4c54-9865-24dc4f383e8d tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments/74f102ce-93d2-4ee7-8163-ed3d0e162842" status: 202 len: 0 microversion: 2.1 time: 0.192109 Aug 24 14:52:53.222962 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 534/1073] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Aug 24 14:52:53 2022] DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments/74f102ce-93d2-4ee7-8163-ed3d0e162842 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:52:53.232441 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:53.234752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:53.242385 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:53.242898 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:53.243333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:53.244038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:53.244485 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:53.244909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:53.279075 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-91691ff7-ceed-4dbc-a31d-13975551d938 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051304 Aug 24 14:52:53.282774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 540/1074] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:52:53 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:54.294377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:54.300517 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:54.307655 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.308299 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.308737 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.309445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.309903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.310320 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.344144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ce53eb85-71e6-4de6-9588-bd7a17757913 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054411 Aug 24 14:52:54.345088 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 535/1075] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Aug 24 14:52:54 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:52:54.412609 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:54.413191 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:54.420643 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.421150 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.421587 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.422303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.422838 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.423261 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.454767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:52:54.566553 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-fb0bb99c-abfc-470f-aa32-46c0f6e16b6a tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 204 len: 0 microversion: 2.1 time: 0.157590 Aug 24 14:52:54.567751 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 541/1076] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:52:54 2022] DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:54.579172 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:54.580008 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:54.586425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.587053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.587546 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.591993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:54.591993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:54.591993 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:54.746225 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:54.754550 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5af17926-590f-4de9-a6ba-6bc72c3c68a7 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1679 microversion: 2.1 time: 0.182166 Aug 24 14:52:54.755144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 536/1077] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:54 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:55.777511 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:55.778242 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:55.785618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:55.786116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:55.786551 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:55.787269 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:55.787718 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:55.788126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:55.933010 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:55.941094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-57942ee5-1647-4002-95e1-ce0d7928d657 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1679 microversion: 2.1 time: 0.168096 Aug 24 14:52:55.941654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 542/1078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:55 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:56.969053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:56.969903 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:56.977513 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:56.977995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:56.978425 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:56.979157 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:56.979604 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:56.980017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:57.119365 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:57.127997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-691a127b-24ab-4d2f-be17-0e2db6f19920 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1679 microversion: 2.1 time: 0.164217 Aug 24 14:52:57.128672 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 537/1079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:56 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:57.989652 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea82e0d-d784-42ff-8186-d2555fea5b1c", "name": "network-vif-deleted", "tag": "bb14434e-dea8-497e-8796-522bf2d3310c"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:58.004107 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:58.004513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:58.004997 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:58.031272 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] Creating event network-vif-deleted:bb14434e-dea8-497e-8796-522bf2d3310c for instance cea82e0d-d784-42ff-8186-d2555fea5b1c on hv-cinder-84889 Aug 24 14:52:58.037806 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-7667907f-3e2d-4147-be38-ba4bc1167079 req-2693fa92-154a-41ca-9cab-3a7f923ed983 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053278 Aug 24 14:52:58.038426 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 543/1080] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:58.149635 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:58.150266 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:58.157811 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:58.158268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:58.159098 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:58.160193 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:58.160939 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:58.161440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:58.208437 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:58.209146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:58.209677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:58.210140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lazy-loading 'fault' on Instance uuid cea82e0d-d784-42ff-8186-d2555fea5b1c {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:52:58.261775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a99d0b60a1a445ba1c7259e762606f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78323470ede148b9a51d726b478d0908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:58.270930 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-439bb0b5-f206-4f9e-be1a-b67c2d9220e8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 200 len: 1331 microversion: 2.1 time: 0.125247 Aug 24 14:52:58.276605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 538/1081] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:58 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:59.295214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:59.295919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:59.303305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:59.303841 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:59.304281 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:59.305068 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:59.305521 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:59.305925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:59.320072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c HTTP/1.1 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:52:59.321713 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:52:59.323287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'cea82e0d-d784-42ff-8186-d2555fea5b1c'} Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:59.324092 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:52:59.325714 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:52:59.327427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:59.327427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-049e6973-7e22-40ab-8f5b-240120ffe40e tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 404 len: 111 microversion: 2.1 time: 0.033162 Aug 24 14:52:59.327427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 544/1082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:59 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:52:59.335767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-87d22900-30d8-403e-8496-02824f0d3e66 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '.version_select at 0x7f8749b3cf70>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:59.358689 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-87d22900-30d8-403e-8496-02824f0d3e66 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471945363" status: 202 len: 0 microversion: 2.1 time: 0.028632 Aug 24 14:52:59.359184 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 539/1083] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Aug 24 14:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471945363 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:53:01.133390 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:01.133975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:01.141497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:01.141975 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:01.142403 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:01.143122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:01.143569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:01.143983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:01.157823 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c HTTP/1.1 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:01.159424 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.161044 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'cea82e0d-d784-42ff-8186-d2555fea5b1c'} Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:01.161958 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.163517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.165338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:01.165338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-05f7fa0f-b362-49c2-a888-b81e35ed9c33 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 404 len: 111 microversion: 2.1 time: 0.031389 Aug 24 14:53:01.165338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 545/1084] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:53:01 2022] DELETE /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:01.170046 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:01.170678 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: cea82e0d-d784-42ff-8186-d2555fea5b1c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:01.177987 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:01.178466 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:01.178934 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:01.179630 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:01.180076 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:01.180520 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:01.194282 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c HTTP/1.1 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:01.196049 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.198547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': 'cea82e0d-d784-42ff-8186-d2555fea5b1c'} Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:01.200012 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. Aug 24 14:53:01.202107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:01.204239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance cea82e0d-d784-42ff-8186-d2555fea5b1c could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:01.204239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-97d9c1f3-2dc9-4d03-8757-86fabb9dadb2 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c" status: 404 len: 111 microversion: 2.1 time: 0.031861 Aug 24 14:53:01.204239 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 540/1085] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:01 2022] GET /compute/v2.1/servers/cea82e0d-d784-42ff-8186-d2555fea5b1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:02.350449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:02.351054 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:02.357743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.358226 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.358679 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.359472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.359818 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.360235 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.374082 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 HTTP/1.1 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:02.375844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.377370 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'ae1a5820-af28-411e-a24a-dfcfe69568a3'} Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:02.378388 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.379886 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.381431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:02.381431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-99e8450c-a65c-402e-afc8-aa2d779fcc97 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 404 len: 111 microversion: 2.1 time: 0.030656 Aug 24 14:53:02.381431 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 546/1086] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:53:02 2022] DELETE /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:02.386017 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:02.386658 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: ae1a5820-af28-411e-a24a-dfcfe69568a3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:02.397373 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.398214 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.399134 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.399841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.400374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.400790 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.415028 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 HTTP/1.1 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:02.416563 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.417988 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': 'ae1a5820-af28-411e-a24a-dfcfe69568a3'} Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:02.418928 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. Aug 24 14:53:02.420208 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.421407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance ae1a5820-af28-411e-a24a-dfcfe69568a3 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:02.421407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-411bec8a-73db-4ecf-9da7-a3b1adcb9ee6 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3" status: 404 len: 111 microversion: 2.1 time: 0.035968 Aug 24 14:53:02.421407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 541/1087] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:02 2022] GET /compute/v2.1/servers/ae1a5820-af28-411e-a24a-dfcfe69568a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:02.429763 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:02.430391 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:02.437945 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.438436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.438909 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.439607 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.440065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.440491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.459069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 HTTP/1.1 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:02.461465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.463262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '80911f96-9e7c-4505-a15b-826a576bf0b8'} Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:02.464303 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.465865 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.467538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:02.467538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d8b49a61-531c-4e97-aaea-90507be3d1c8 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 404 len: 111 microversion: 2.1 time: 0.039735 Aug 24 14:53:02.467538 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 547/1088] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:53:02 2022] DELETE /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:02.471607 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:02.472440 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: 80911f96-9e7c-4505-a15b-826a576bf0b8] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:02.478915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.479400 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.479840 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.480535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:02.481019 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:02.481445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:02.496490 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 HTTP/1.1 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:02.498084 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.499731 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '80911f96-9e7c-4505-a15b-826a576bf0b8'} Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:02.500468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. Aug 24 14:53:02.501677 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:02.502805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance 80911f96-9e7c-4505-a15b-826a576bf0b8 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:02.502805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-953e277f-151d-4f57-9148-884581cfea8f tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8" status: 404 len: 111 microversion: 2.1 time: 0.031859 Aug 24 14:53:02.502805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 542/1089] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:02 2022] GET /compute/v2.1/servers/80911f96-9e7c-4505-a15b-826a576bf0b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:03.655680 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:03.656324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:03.663366 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:03.663853 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:03.664294 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:03.664994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:03.665450 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:03.665874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:03.680654 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 HTTP/1.1 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:03.682243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.683877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'a94b0efc-7058-4b0c-a81b-ed4dd135d600'} Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:03.684746 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.686282 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.687925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:03.687925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d2990966-1423-4bbf-9123-49aca4e5c891 tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 404 len: 111 microversion: 2.1 time: 0.031868 Aug 24 14:53:03.687925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 548/1090] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:53:03 2022] DELETE /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:03.696496 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:03.697107 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] [instance: a94b0efc-7058-4b0c-a81b-ed4dd135d600] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:03.704576 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:03.705054 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:03.705483 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:03.706174 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:03.706622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:03.707452 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:03.721724 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] HTTP exception thrown: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Request method failure captured: Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 HTTP/1.1 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjocDXwuAzQC8C6spmPr7rxRxgv5IDZSbue3oT-T9I7nk_kRc_dPQMtfIySH7Bkl1feqZQcA1erDsk5fGqRmV_vsZdE3qwhugNsqF4SqJAismSA5X8QDXk8odtB5jfBINBQO8Ubx74RRXS1_CJU_MhYdSt-daGf2ho6g6JTbPYFQDg8 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:03.723298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_78323470ede148b9a51d726b478d0908", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/78323470ede148b9a51d726b478d0908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/78323470ede148b9a51d726b478d0908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 78323470ede148b9a51d726b478d0908 Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1210161451 Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: 6a99d0b60a1a445ba1c7259e762606f9 Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1210161451-project Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.724849 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': 'a94b0efc-7058-4b0c-a81b-ed4dd135d600'} Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:03.725949 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. Aug 24 14:53:03.727519 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:03.729025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] Returning 404 to user: Instance a94b0efc-7058-4b0c-a81b-ed4dd135d600 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:03.729025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-56e667c7-0c5f-4ae3-b7e1-fee6c6a34ffa tempest-AttachVolumeNegativeTest-1210161451 tempest-AttachVolumeNegativeTest-1210161451-project] 10.222.0.90 "GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600" status: 404 len: 111 microversion: 2.1 time: 0.032118 Aug 24 14:53:03.729025 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 543/1091] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:03 2022] GET /compute/v2.1/servers/a94b0efc-7058-4b0c-a81b-ed4dd135d600 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:53:06.546962 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:06.550796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:06.559325 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.559814 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.560255 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:06.560952 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.561405 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.561844 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:06.596385 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4838faff-f3d5-40f0-a2f7-9127e73a2fc2 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053774 Aug 24 14:53:06.596658 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 549/1092] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Aug 24 14:53:06 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:06.664984 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:06.666329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:06.674159 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.674804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.675334 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:06.676278 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.676951 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.677619 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:06.706692 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:53:06.785721 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-84567f4e-115f-498d-923c-f4a017f5bbd9 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 204 len: 0 microversion: 2.20 time: 0.124407 Aug 24 14:53:06.786880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 544/1093] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Aug 24 14:53:06 2022] DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 14:53:06.796028 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:06.796875 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:06.804767 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.806735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.807450 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:06.808305 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:06.808859 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:06.809375 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:07.061994 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:07.073514 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:07.075350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:07.077101 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-91b621d7-2e82-4876-b3a1-a0513c68c86d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.285419 Aug 24 14:53:07.078335 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 550/1094] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:06 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:53:08.110110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:08.111074 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:08.117540 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:08.118283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:08.118749 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:08.119527 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:08.119881 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:08.120286 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:08.283898 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:08.292407 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:08.293925 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:08.295140 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-274d46ce-2449-49f0-9425-f519a4552d3a tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1724 microversion: 2.20 time: 0.189639 Aug 24 14:53:08.295699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 545/1095] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:08 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:53:09.318660 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:09.319367 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:09.325644 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:09.326193 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:09.326764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:09.328650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:09.328650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:09.328650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:09.447500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:09.458346 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:09.460287 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0b28db79b1b4a97a26c1df848bc4de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e9fa5bcdaf445a91ef2229fca7b1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:09.461724 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-2102a0df-a2fc-4f9a-90bd-e5830847ad87 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 200 len: 1656 microversion: 2.20 time: 0.147990 Aug 24 14:53:09.463218 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 551/1096] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:09 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 1656 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:53:09.545281 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6873ce2-f6f4-4c24-b85d-e88cde554958", "name": "network-vif-deleted", "tag": "4b29e431-69db-487c-809b-956b2d91793f"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:09.556029 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:09.556414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:09.556843 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:09.572212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] Creating event network-vif-deleted:4b29e431-69db-487c-809b-956b2d91793f for instance c6873ce2-f6f4-4c24-b85d-e88cde554958 on hv-cinder-84889 Aug 24 14:53:09.581001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-12cada38-19b9-4031-aef7-94f9d2fafeba req-95858a34-a229-4411-bc99-20e5077f0305 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036148 Aug 24 14:53:09.586016 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 546/1097] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:53:10.486451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:10.487078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:10.493866 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:10.494350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:10.494989 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:10.495692 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:10.496386 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:10.496543 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:10.512495 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 HTTP/1.1 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:10.514129 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:10.516270 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'c6873ce2-f6f4-4c24-b85d-e88cde554958'} Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:10.517083 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:10.518451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:10.519648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:10.519648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-df8ef60c-e79a-45a4-90a7-d00770e37360 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 404 len: 111 microversion: 2.20 time: 0.034525 Aug 24 14:53:10.519648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 552/1098] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:10 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:10.527617 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aff38ccc-c9fd-4dfc-83d5-e538ab50dd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '.version_select at 0x7f8749bcf8b0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:10.548560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aff38ccc-c9fd-4dfc-83d5-e538ab50dd9d tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969579059" status: 204 len: 0 microversion: 2.20 time: 0.025401 Aug 24 14:53:10.549454 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 547/1099] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Aug 24 14:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969579059 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:53:12.364232 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:12.364764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:12.371265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:12.371743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:12.372182 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:12.372878 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:12.373442 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:12.373737 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:12.387833 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 HTTP/1.1 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:12.389401 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.391531 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': 'c6873ce2-f6f4-4c24-b85d-e88cde554958'} Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:12.392598 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.394103 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.395653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:12.395653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-38c25728-ff49-4cd6-8404-f5b3db2d4fcd tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 404 len: 111 microversion: 2.20 time: 0.030976 Aug 24 14:53:12.395653 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 553/1100] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Aug 24 14:53:12 2022] DELETE /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:12.401504 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:12.402295 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: c6873ce2-f6f4-4c24-b85d-e88cde554958] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:12.409450 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:12.409947 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:12.410503 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:12.411212 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:12.411660 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:12.412077 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:12.425907 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 HTTP/1.1 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:12.427661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.429438 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': 'c6873ce2-f6f4-4c24-b85d-e88cde554958'} Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:12.433805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. Aug 24 14:53:12.435298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:12.436726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance c6873ce2-f6f4-4c24-b85d-e88cde554958 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:12.436726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a1b54c9-19a8-4f6d-85cb-1c93afcd0f16 tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958" status: 404 len: 111 microversion: 2.20 time: 0.032437 Aug 24 14:53:12.436726 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 548/1101] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:12 2022] GET /compute/v2.1/servers/c6873ce2-f6f4-4c24-b85d-e88cde554958 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:13.587776 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:13.588293 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:13.595267 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:13.595753 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:13.596189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:13.596896 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:13.597326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:13.597755 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:13.611602 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a HTTP/1.1 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:13.613183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.614930 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '95c28cb3-2878-47e2-97a0-c8534823a20a'} Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:13.615904 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.617446 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.618995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:13.618995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8486a3ae-3d75-42dd-9e3e-879789efc81e tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 404 len: 111 microversion: 2.20 time: 0.030755 Aug 24 14:53:13.618995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 554/1102] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Aug 24 14:53:13 2022] DELETE /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:13.624059 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:13.624783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] [instance: 95c28cb3-2878-47e2-97a0-c8534823a20a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:13.627262 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:13.633026 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:13.633698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:13.634642 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:13.635346 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:13.635796 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:13.636217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:13.641121 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:13.653372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] HTTP exception thrown: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Request method failure captured: Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a HTTP/1.1 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Connection: close Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Host: 10.222.0.90 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABjBjnRMcqRqcKd0ogQg_UfwxXzMHfWgq2QxYen3ivImtIe70-WAep1Aawtde-4IV5Alunxb4uH3V7GiXKYUd2Ht2SxZvqtEb9m6t7vHLY21Mztwks9UpG3ZzgNPJWiV90JAAqu3qbeiU3WA86Tm0N7pNhX9CSxEW8raZ-LGY7xqzZPV80 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 24 14:53:13.654955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_97e9fa5bcdaf445a91ef2229fca7b1c9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/97e9fa5bcdaf445a91ef2229fca7b1c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 97e9fa5bcdaf445a91ef2229fca7b1c9 Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790478903 Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Id: b0b28db79b1b4a97a26c1df848bc4de5 Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790478903-project Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: method: > Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: exception: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.656484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: action_args: {'id': '95c28cb3-2878-47e2-97a0-c8534823a20a'} Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:13.657221 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. Aug 24 14:53:13.658423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 24 14:53:13.660661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] Returning 404 to user: Instance 95c28cb3-2878-47e2-97a0-c8534823a20a could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:13.660661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9cfa0b8b-0772-4069-825d-9c522ea8258c tempest-AttachVolumeShelveTestJSON-1790478903 tempest-AttachVolumeShelveTestJSON-1790478903-project] 10.222.0.90 "GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a" status: 404 len: 111 microversion: 2.20 time: 0.036743 Aug 24 14:53:13.660661 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 549/1103] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Aug 24 14:53:13 2022] GET /compute/v2.1/servers/95c28cb3-2878-47e2-97a0-c8534823a20a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:39.647669 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2137120969", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "networks": [{"uuid": "5f9ca9ca-45f7-4fa2-9d9e-21cf48f83fac"}]}} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:39.656045 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:39.656764 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:39.711619 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.network.neutron [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] validate_networks() for [('5f9ca9ca-45f7-4fa2-9d9e-21cf48f83fac', None, None, None, None, None)] {{(pid=127296) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:53:40.077449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Flavor limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:53:40.077829 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Image limits 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:53:40.078334 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Flavor pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:53:40.078848 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Image pref 0:0:0 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:53:40.079262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.virt.hardware [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:53:40.088565 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:40.089047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:40.089476 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:40.090189 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:40.090672 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:40.091094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:40.109449 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Getting quotas for project c3f6ad3d04954676864a46fee6e7a6d6. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:53:40.113735 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.quota [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Getting quotas for user 5c3f61ba81ad424b826840bce6533e6c and project c3f6ad3d04954676864a46fee6e7a6d6. Resources: {'ram', 'instances', 'cores'} {{(pid=127296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:53:40.125996 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Going to run 1 instances... {{(pid=127296) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:53:40.128333 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:53:40.178005 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-0fb3f06f-b570-4be8-84b7-d20a0ee8e4d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534279 Aug 24 14:53:40.178696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 555/1104] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:53:40.190802 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-847b2599-6e8f-4eca-ac87-926d78e848f5 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:40.191441 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-847b2599-6e8f-4eca-ac87-926d78e848f5 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:40.194815 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:40.251745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-847b2599-6e8f-4eca-ac87-926d78e848f5 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:40.258955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-847b2599-6e8f-4eca-ac87-926d78e848f5 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1214 microversion: 2.1 time: 0.072877 Aug 24 14:53:40.259547 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 550/1105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:40 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:41.280969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:41.281659 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:41.288326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:41.288799 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:41.289222 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:41.289910 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:41.290354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:41.290804 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:41.358354 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:41.366849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6a7a6e5-7fef-4191-9400-02896373b7e1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1218 microversion: 2.1 time: 0.090193 Aug 24 14:53:41.367439 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 556/1106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:41 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:42.390998 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:42.391612 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:42.399399 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:42.399883 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:42.400312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:42.401130 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:42.401579 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:42.401999 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:42.472622 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:42.481488 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e73aef2e-353a-46f5-9ef4-ca061a775153 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1210 microversion: 2.1 time: 0.096978 Aug 24 14:53:42.482277 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 551/1107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:42 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:43.503419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:43.504019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:43.510469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:43.511017 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:43.511440 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:43.512128 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:43.512571 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:43.512983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:43.587758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:43.596350 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-e6dbd945-28a8-4b9c-9acd-e37c2e5406f6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1272 microversion: 2.1 time: 0.096958 Aug 24 14:53:43.596907 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 557/1108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:43 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:44.398688 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d6f443-6f37-4b8c-8dce-df9239957ba5", "tag": "724a89c5-bd9f-4be9-8137-f2e2404776d0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:44.409956 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:44.410535 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:44.411048 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:44.423760 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] Creating event network-changed:724a89c5-bd9f-4be9-8137-f2e2404776d0 for instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 on hv-cinder-84889 Aug 24 14:53:44.429182 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-98075f25-230f-4c81-9bb4-d59b09ab4a3b req-72388f0c-cb1f-4fbc-9d28-a9370f98b29d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Aug 24 14:53:44.430169 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 552/1109] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:44.617457 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:44.618196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:44.625928 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:44.626539 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:44.626982 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:44.627726 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:44.628250 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:44.628691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:44.863919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:44.871998 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-eec512e2-a0f1-4168-9afd-bb18c6382c50 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.258873 Aug 24 14:53:44.885078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 558/1110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:44 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:45.894070 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:45.894859 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:45.901982 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:45.902761 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:45.903024 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:45.903716 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:45.904233 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:45.904710 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:46.052426 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:46.060433 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-41a2e4f7-372a-4294-a1ac-977baf89da7c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.171695 Aug 24 14:53:46.061018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 553/1111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:45 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:47.087080 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:47.087992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:47.099265 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:47.100078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:47.100796 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:47.101925 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:47.102716 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:47.103427 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:47.252392 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:47.260184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-6c4c6e13-71a8-462f-b80a-bb41c656fcd2 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.179850 Aug 24 14:53:47.260743 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 559/1112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:47 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:48.288626 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:48.289865 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:48.297640 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:48.298615 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:48.299024 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:48.299772 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:48.300217 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:48.300668 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:48.447311 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:48.455476 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-52ad7514-4e75-4c35-8cfd-48029708fef6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.173827 Aug 24 14:53:48.456064 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 554/1113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:48 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:49.477517 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:49.478247 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:49.486089 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:49.486758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:49.487336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:49.488314 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:49.488924 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:49.489448 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:49.639151 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:49.651938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3875113e-c754-4758-8fc5-c0dfe94afd47 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.178978 Aug 24 14:53:49.652648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 560/1114] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:49 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:50.673767 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:50.674390 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:50.676920 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:50.682789 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:50.683268 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:50.683698 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:50.684393 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:50.684817 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:50.685244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:50.823990 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:50.832422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4142d967-bd7f-46c0-b0f5-42b5b706832a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.162699 Aug 24 14:53:50.833007 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 555/1115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:50 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:51.853537 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:51.854160 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:51.856053 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:51.856712 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=6 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:51.863414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:51.863894 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:51.864319 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:51.865010 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:51.865451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:51.865864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:52.004123 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:52.012144 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-da03331d-b2ac-4632-839b-db9c7494604f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.162404 Aug 24 14:53:52.012719 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 561/1116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:51 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:52.401887 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6f443-6f37-4b8c-8dce-df9239957ba5", "name": "network-vif-plugged", "status": "completed", "tag": "724a89c5-bd9f-4be9-8137-f2e2404776d0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:52.418451 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:52.419335 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:52.420259 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:52.443243 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] Creating event network-vif-plugged:724a89c5-bd9f-4be9-8137-f2e2404776d0 for instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 on hv-cinder-84889 Aug 24 14:53:52.452478 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a96e2a8a-34e2-4db2-81af-86a6461c715a req-48d7eeaa-7b88-43aa-a89c-35fb3cf53cfd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057218 Aug 24 14:53:52.453781 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 556/1117] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:53.033647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:53.034228 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:53.042618 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.043243 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.043831 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.044762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.045297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.045691 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.191986 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:53.200122 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-ef5a133e-729c-4a54-b270-46f47493639c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.170647 Aug 24 14:53:53.200704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 562/1118] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:53 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:54.223991 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:54.225032 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:54.234763 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:54.235699 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:54.236722 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:54.238352 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:54.238850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:54.239533 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:54.408715 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:54.417360 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0e0343df-0a39-48c1-aae4-2d88861ebf8a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1314 microversion: 2.1 time: 0.200674 Aug 24 14:53:54.417853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 557/1119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:54 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:55.437870 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:55.438809 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:55.445534 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:55.446019 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:55.446489 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:55.447158 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:55.447957 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:55.448444 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:55.585967 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:55.593976 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-4cbc3677-5af6-4929-91f4-9afc15cc5dab tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1497 microversion: 2.1 time: 0.160229 Aug 24 14:53:55.595034 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 563/1120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:55 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:56.109572 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:56.110114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:56.118878 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.119363 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.119793 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.120561 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.120915 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.121656 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.148734 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:53:56.233676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dcb576e3-7054-46a7-bf5a-b7e9facdfd2d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "DELETE /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 204 len: 0 microversion: 2.1 time: 0.127856 Aug 24 14:53:56.234892 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 558/1121] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:53:56 2022] DELETE /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:53:56.243856 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:56.244625 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:56.256566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.257063 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.257500 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.258215 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.258704 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.259176 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.408360 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:56.416395 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-24b5ed77-3be0-44a3-b2ea-23b721a9c083 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1503 microversion: 2.1 time: 0.176659 Aug 24 14:53:56.416979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 564/1122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:56 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:57.439235 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:57.439997 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:57.447515 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:57.447994 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:57.448421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:57.449110 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:57.449552 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:57.450562 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:57.600958 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:57.617396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d9b6e9d-808a-4451-b651-97259fe03e77 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1503 microversion: 2.1 time: 0.182274 Aug 24 14:53:57.618303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 559/1123] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:57 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:58.575556 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6f443-6f37-4b8c-8dce-df9239957ba5", "name": "network-vif-deleted", "tag": "724a89c5-bd9f-4be9-8137-f2e2404776d0"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:58.587041 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:58.587845 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:58.588506 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:58.603368 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] Creating event network-vif-deleted:724a89c5-bd9f-4be9-8137-f2e2404776d0 for instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 on hv-cinder-84889 Aug 24 14:53:58.608922 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-07d83471-82bc-4e2f-a5a1-9763efe33495 req-1e1f820a-174b-4bd6-8c0b-c9a20fcd11c2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043053 Aug 24 14:53:58.609664 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 565/1124] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:58.638560 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:58.639298 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:58.647968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:58.648414 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:58.648850 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:58.649601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:58.650053 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:58.650473 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:58.722075 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:53:58.730013 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4166c4f7-7fd1-4343-894a-8e430e285ed1 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 200 len: 1299 microversion: 2.1 time: 0.095522 Aug 24 14:53:58.730616 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 560/1125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:58 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:53:59.754404 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:59.755239 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 60d6f443-6f37-4b8c-8dce-df9239957ba5] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:59.762709 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:59.763260 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:59.763758 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:59.764530 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:59.765047 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:59.765919 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:59.780885 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] HTTP exception thrown: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Request method failure captured: Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 HTTP/1.1 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjtvJ20zLq0z9q5RPE0PVBGYVV-WkDY5ioLHbZz4tnr9xlquP59hX8dUk_9ExdZ2oQLTQHkpicJ0ZHjkQFPZ2x3moeBZBoE3NJ9qnjxnVWNgy0sc2CC7wg8Z_XeFqZUyepSd-tZr4mez6-_GJDqI3ieVyWfrIBKEwxGrb-SUp2XrCXQ Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: c3f6ad3d04954676864a46fee6e7a6d6 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesActionsTest-1602862290 Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:53:59.783338 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c3f6ad3d04954676864a46fee6e7a6d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesActionsTest-1602862290 Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: c3f6ad3d04954676864a46fee6e7a6d6 Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesActionsTest-1602862290 Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesActionsTest-1602862290-project Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 5c3f61ba81ad424b826840bce6533e6c Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesActionsTest-1602862290-project Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. Aug 24 14:53:59.784979 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '60d6f443-6f37-4b8c-8dce-df9239957ba5'} Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:59.786012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. Aug 24 14:53:59.787650 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:53:59.788983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Returning 404 to user: Instance 60d6f443-6f37-4b8c-8dce-df9239957ba5 could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:59.788983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-5a927773-9f88-4d3f-b23a-b9dc00b673aa tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5" status: 404 len: 111 microversion: 2.1 time: 0.035911 Aug 24 14:53:59.788983 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 566/1126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:53:59 2022] GET /compute/v2.1/servers/60d6f443-6f37-4b8c-8dce-df9239957ba5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:53:59.893011 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1043398730", "imageRef": "414281e9-a552-4da5-8fb4-e8fdbe5e76bd", "flavorRef": "452", "networks": [{"uuid": "5f9ca9ca-45f7-4fa2-9d9e-21cf48f83fac"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:59.958291 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] validate_networks() for [('5f9ca9ca-45f7-4fa2-9d9e-21cf48f83fac', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:54:00.343502 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:54:00.344082 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:54:00.344564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:54:00.344973 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:54:00.345383 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:54:00.356312 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.356804 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.357244 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.357968 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.358421 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.358875 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.376709 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Getting quotas for project c3f6ad3d04954676864a46fee6e7a6d6. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:54:00.381035 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Getting quotas for user 5c3f61ba81ad424b826840bce6533e6c and project c3f6ad3d04954676864a46fee6e7a6d6. Resources: {'ram', 'instances', 'cores'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:54:00.393775 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:54:00.396101 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='414281e9-a552-4da5-8fb4-e8fdbe5e76bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:54:00.444620 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-38e6b5bf-49b9-4082-a455-15ab4005e56b tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556009 Aug 24 14:54:00.445306 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 561/1127] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Aug 24 14:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:54:00.456414 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-8cc29543-1105-4368-9cf2-933247b30802 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:00.457118 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-8cc29543-1105-4368-9cf2-933247b30802 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:00.511417 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-8cc29543-1105-4368-9cf2-933247b30802 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:00.519196 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-8cc29543-1105-4368-9cf2-933247b30802 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1214 microversion: 2.1 time: 0.066739 Aug 24 14:54:00.519774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 567/1128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:00 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:01.542047 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:01.542627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:01.549564 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:01.550283 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:01.550795 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:01.551847 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:01.552336 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:01.552749 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:01.616241 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:01.624853 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b7015929-247c-4f16-8cec-c74864318777 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1218 microversion: 2.1 time: 0.087325 Aug 24 14:54:01.625458 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 562/1129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:01 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:02.646078 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:02.646687 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:02.656647 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:02.657168 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:02.657600 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:02.658278 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:02.658795 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:02.659184 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:02.721626 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:02.729674 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d771127f-4dba-46fd-95c8-985b7229ca70 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1218 microversion: 2.1 time: 0.087558 Aug 24 14:54:02.730251 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 568/1130] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:02 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:03.752192 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:03.753493 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:03.762010 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:03.762500 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:03.770792 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:03.771553 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:03.772315 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:03.772641 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:03.853679 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:03.864841 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da6a659f-c89f-4e56-8cec-d04169f81356 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1274 microversion: 2.1 time: 0.116745 Aug 24 14:54:03.865729 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 563/1131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:03 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:04.888789 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:04.889466 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:04.896964 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:04.897443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:04.897899 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:04.898589 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:04.899072 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:04.899491 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:05.175508 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:05.184181 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-315b00f7-45f9-4026-bec0-343d3229f200 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.299277 Aug 24 14:54:05.185012 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 569/1132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:04 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:05.533114 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a", "tag": "f54f39ab-d61c-40e8-804e-1b0af7af7636"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:05.545100 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:05.545611 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:05.546018 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:05.558468 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] Creating event network-changed:f54f39ab-d61c-40e8-804e-1b0af7af7636 for instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a on hv-cinder-84889 Aug 24 14:54:05.563684 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9f52f54f-fa75-4030-8627-79b6631bfac9 req-c1e831b9-4973-4112-849e-18fe90e041d5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035109 Aug 24 14:54:05.564406 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 564/1133] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:06.204447 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:06.205102 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:06.212739 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:06.213580 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:06.214297 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:06.215043 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:06.215603 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:06.216015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:06.390194 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:06.398451 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-b6213f34-3b8d-4b7d-8e9e-5a5167fc706c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.197976 Aug 24 14:54:06.399070 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 570/1134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:06 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:07.422372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:07.423118 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:07.429474 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:07.429938 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:07.430378 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:07.431119 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:07.431569 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:07.431983 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:07.571506 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:07.579329 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-75cf0ee8-e9c2-495a-9b77-5e50bf19efc4 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.161759 Aug 24 14:54:07.579899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 565/1135] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:07 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:08.602630 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:08.603383 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:08.612599 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:08.613465 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:08.614135 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:08.615201 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:08.616015 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:08.616469 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:08.778324 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:08.787443 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-d1f193e6-e288-4303-b107-3cdc7eb958d7 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.190994 Aug 24 14:54:08.788126 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 571/1136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:08 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:09.808367 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:09.808955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:09.816045 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:09.816571 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:09.817001 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:09.817705 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:09.818154 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:09.818602 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:09.975023 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:09.985445 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-80be32a0-a904-4a37-b7c9-5c26daaa4142 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.181024 Aug 24 14:54:09.986057 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 566/1137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:09 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:10.568611 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell0:SELECT=2 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:10.573065 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a", "name": "network-vif-plugged", "status": "completed", "tag": "f54f39ab-d61c-40e8-804e-1b0af7af7636"}]} {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:10.578938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:10.585936 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:10.586419 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:10.586877 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:10.590094 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG dbcounter [-] [127296] Writing DB stats nova_cell1:SELECT=85 {{(pid=127296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:10.601781 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.compute.server_external_events [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] Creating event network-vif-plugged:f54f39ab-d61c-40e8-804e-1b0af7af7636 for instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a on hv-cinder-84889 Aug 24 14:54:10.607336 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [req-0d2a8b57-df5c-444e-9e7a-54cbbee74902 req-628fa6ba-35c5-48d4-b874-a4f6b45a8a68 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Aug 24 14:54:10.608003 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 572/1138] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:11.007596 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:11.008292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:11.011449 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:11.012127 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:11.013647 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:11.021265 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:11.021787 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:11.022209 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:11.022955 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:11.023401 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:11.023826 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:11.027676 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:11.178030 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:11.188158 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-344a025e-5c8d-4feb-a994-1598172580e6 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.185073 Aug 24 14:54:11.188743 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 567/1139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:11 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:12.211210 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:12.212262 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:12.219056 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:12.219527 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:12.220183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:12.220882 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:12.221321 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:12.221752 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:12.432849 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:12.441969 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-a7488c0b-b6e0-471a-b545-b98d1b2c93eb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1314 microversion: 2.1 time: 0.235167 Aug 24 14:54:12.449889 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 573/1140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:12 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:13.464919 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:13.465395 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:13.473396 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:13.473799 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:13.474236 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:13.474975 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:13.475429 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:13.475953 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:13.610024 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:13.617717 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-73eba33d-b59c-4121-b606-548529a3884a tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1497 microversion: 2.1 time: 0.157125 Aug 24 14:54:13.618525 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 568/1141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:13 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:14.178266 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:14.179061 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:14.187966 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.188857 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.189397 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.190326 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.191098 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.191595 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.224459 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Going to try to terminate instance {{(pid=127296) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:54:14.308183 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-f49ee163-3c27-4967-a2d2-89e4e890de68 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 204 len: 0 microversion: 2.1 time: 0.134838 Aug 24 14:54:14.309051 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 574/1142] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Aug 24 14:54:14 2022] DELETE /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:54:14.317805 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:14.318484 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:14.330165 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.330891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.331600 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.332894 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.333423 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.333917 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.488146 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:14.496372 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b65e81ec-76ef-4f86-9628-7482a509587f tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1503 microversion: 2.1 time: 0.182632 Aug 24 14:54:14.496957 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 569/1143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:14 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:15.525559 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:15.526472 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:15.533187 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:15.533569 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:15.534240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:15.534992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:15.535436 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:15.535846 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:15.706198 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:15.714929 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-3e211a1f-d1e2-4a66-88f6-5341380b1e09 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1503 microversion: 2.1 time: 0.193668 Aug 24 14:54:15.715519 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 575/1144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:15 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:16.738422 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:16.739041 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:16.745932 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:16.746415 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:16.746872 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:16.747601 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:16.748042 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:16.748460 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:16.887131 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:16.896303 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-53d6d9d8-0c47-43c8-8bd4-5085bc1692cb tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1503 microversion: 2.1 time: 0.161752 Aug 24 14:54:16.896899 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 570/1145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:16 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:17.917295 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:17.917895 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:17.925038 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:17.925521 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:17.925953 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:17.926696 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:17.927165 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:17.927582 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:18.065708 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:18.074141 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-050656e1-c0f7-485e-8a27-28ef1b900a71 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1503 microversion: 2.1 time: 0.160679 Aug 24 14:54:18.074774 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 576/1146] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:17 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:19.031176 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a", "name": "network-vif-deleted", "tag": "f54f39ab-d61c-40e8-804e-1b0af7af7636"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:19.043941 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.044436 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.044891 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.056906 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] Creating event network-vif-deleted:f54f39ab-d61c-40e8-804e-1b0af7af7636 for instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a on hv-cinder-84889 Aug 24 14:54:19.062135 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-ebab64a5-b8eb-4696-92a3-4bd49d2eb260 req-2a2ea71e-4a9e-4211-b3a7-69396d91405c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034754 Aug 24 14:54:19.062783 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 571/1147] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:19.096464 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:19.097046 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:19.104604 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.105214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.105656 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.106438 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.106992 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.107567 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.179762 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:19.192140 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-88dc9c7f-d442-4fc0-b32c-dca96d6eae3c tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1299 microversion: 2.1 time: 0.099675 Aug 24 14:54:19.193069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 577/1148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:19 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:20.214995 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:20.215608 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:20.222548 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.223072 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.223505 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.224216 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.224664 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.225126 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.258374 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.258880 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.259308 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.259741 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lazy-loading 'fault' on Instance uuid 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:54:20.302937 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:20.311292 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-58e750ca-f713-4154-8256-a2e978d0933d tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1304 microversion: 2.1 time: 0.101240 Aug 24 14:54:20.311984 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 572/1149] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:20 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:21.332938 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:21.333566 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:21.340513 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.340993 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.341417 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.342116 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.342551 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.343009 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.375874 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.376373 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.376793 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.377240 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.objects.instance [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lazy-loading 'fault' on Instance uuid 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a {{(pid=127296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:54:21.420515 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.policy [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127296) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:21.428915 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-502b70de-cffa-45fe-98f5-f4f22011922e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1304 microversion: 2.1 time: 0.099813 Aug 24 14:54:21.429497 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 578/1150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:21 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:22.450324 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:22.450964 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:22.457649 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.458152 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.458605 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.459377 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.459831 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.460252 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.494839 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.495327 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.495948 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.496384 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lazy-loading 'fault' on Instance uuid 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:54:22.546627 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f61ba81ad424b826840bce6533e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6ad3d04954676864a46fee6e7a6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:22.555888 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8ea53b14-029b-4c07-a742-c0467970dfc9 tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 200 len: 1304 microversion: 2.1 time: 0.109876 Aug 24 14:54:22.556518 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 573/1151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:22 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:23.578699 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Calling method '>' {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:23.579279 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.compute.api [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] [instance: 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a] Fetching instance by UUID {{(pid=127296) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:23.589617 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.590648 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.591124 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.592185 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Acquiring lock "018ea49c-ac3d-448e-85b1-659198c7a196" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.592757 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.593214 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG oslo_concurrency.lockutils [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Lock "018ea49c-ac3d-448e-85b1-659198c7a196" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.610069 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.wsgi [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] HTTP exception thrown: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Request method failure captured: Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: request: GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a HTTP/1.1 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept: application/json Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Accept-Encoding: identity Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Connection: close Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Length: 0 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Content-Type: application/json Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Host: 10.222.0.90 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Openstack-System-Scope: None Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: User-Agent: python-urllib3/1.26.11 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Auth-Token: gAAAAABjBjtvJ20zLq0z9q5RPE0PVBGYVV-WkDY5ioLHbZz4tnr9xlquP59hX8dUk_9ExdZ2oQLTQHkpicJ0ZHjkQFPZ2x3moeBZBoE3NJ9qnjxnVWNgy0sc2CC7wg8Z_XeFqZUyepSd-tZr4mez6-_GJDqI3ieVyWfrIBKEwxGrb-SUp2XrCXQ Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Id: None Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Domain-Name: None Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Identity-Status: Confirmed Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Is-Admin-Project: True Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Id: default Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Domain-Name: Default Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Id: c3f6ad3d04954676864a46fee6e7a6d6 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Project-Name: tempest-VolumesActionsTest-1602862290 Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Role: member,reader Aug 24 14:54:23.611802 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Roles: member,reader Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c3f6ad3d04954676864a46fee6e7a6d6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c3f6ad3d04954676864a46fee6e7a6d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}] Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant: tempest-VolumesActionsTest-1602862290 Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Id: c3f6ad3d04954676864a46fee6e7a6d6 Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-Tenant-Name: tempest-VolumesActionsTest-1602862290 Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User: tempest-VolumesActionsTest-1602862290-project Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Id: default Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Domain-Name: Default Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Id: 5c3f61ba81ad424b826840bce6533e6c Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: X-User-Name: tempest-VolumesActionsTest-1602862290-project Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: method: > Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: exception: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. Aug 24 14:54:23.613528 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: action_args: {'id': '5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a'} Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: {{(pid=127296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:54:23.614381 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. Aug 24 14:54:23.615847 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: ERROR nova.api.openstack.wsgi Aug 24 14:54:23.617105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: DEBUG nova.api.openstack.wsgi [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] Returning 404 to user: Instance 5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a could not be found. {{(pid=127296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:54:23.617105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO nova.api.openstack.requestlog [None req-eb5ca746-175b-47ac-90a6-97301160296e tempest-VolumesActionsTest-1602862290 tempest-VolumesActionsTest-1602862290-project] 10.222.0.90 "GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a" status: 404 len: 111 microversion: 2.1 time: 0.039133 Aug 24 14:54:23.617105 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: [pid: 127296|app: 0|req: 579/1152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:23 2022] GET /compute/v2.1/servers/5dbc0f2f-f2e8-4dfe-aa8a-f9e3358a5f8a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:55:50.283241 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:50.283864 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Wed Aug 24 14:55:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:55:52.643896 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:52.644556 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Wed Aug 24 14:55:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:55:57.773516 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:57.774264 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Wed Aug 24 14:55:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:10.292697 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:10.293480 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Wed Aug 24 14:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:10.962745 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:10.963447 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Wed Aug 24 14:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:12.653144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:12.653144 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Wed Aug 24 14:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:17.782995 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:17.783645 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Wed Aug 24 14:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:27.066356 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:27.067112 dv-cinder-848899-4-iscsi devstack@n-api.service[127296]: Wed Aug 24 14:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:29.520340 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:29.520981 dv-cinder-848899-4-iscsi devstack@n-api.service[127297]: Wed Aug 24 14:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!